After much digging, I figured out that httpd:alpine was giving me the wrong hash.
Here's what I'm doing from now on to generate the correct hashes: ->
docker run --rm -it alpine:latest sh -c "apk add --no-cache apache2-utils && htpasswd -nbm username password"