I found the issue! I have two package.json files - one in my react app and one outside of it. I had my react-router-dom installed in the wrong package.json. Installing it in the react-app itself fixed the problem.