Warning for future readers:

After the first command I did git push --all which resulted in an error, prompting me to git pull so I did, then reran git push --all. The result was a repo with all commits duplicated (and the file I want to delete was untouched). I think that git push --all is wrong, perhaps git push --force is the right command as others mentioned.