This is indeed a problem in the way Pipenv handle this kind of cases. Makes for bisecting clearly troublesome.