Repository navigation
[BUG] Newest 3.12 install on windows misses pip #117505
Description
Activity
Can you zip up all the
Python*.logfiles in your%TEMP%directory and attach them for us? Those should show why the install failed.Issue 117505 logs.zip
@zooba here you go
note that I tried several install/repair so that's why there's so many 😅Reacted by Steve DowerWell this is a very interesting case:
CAQuietExec64: ERROR: Exception: CAQuietExec64: Traceback (most recent call last): CAQuietExec64: File "C:\Users\EDM115\AppData\Local\Temp\tmphbeisq9d\pip-24.0-py3-none-any.whl\pip\_internal\cli\base_command.py", line 180, in exc_logging_wrapper CAQuietExec64: status = run_func(*args) CAQuietExec64: ^^^^^^^^^^^^^^^ CAQuietExec64: File "C:\Users\EDM115\AppData\Local\Temp\tmphbeisq9d\pip-24.0-py3-none-any.whl\pip\_internal\cli\req_command.py", line 245, in wrapper CAQuietExec64: return func(self, options, args) CAQuietExec64: ^^^^^^^^^^^^^^^^^^^^^^^^^ CAQuietExec64: File "C:\Users\EDM115\AppData\Local\Temp\tmphbeisq9d\pip-24.0-py3-none-any.whl\pip\_internal\commands\install.py", line 324, in run CAQuietExec64: session = self.get_default_session(options) CAQuietExec64: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ CAQuietExec64: File "C:\Users\EDM115\AppData\Local\Temp\tmphbeisq9d\pip-24.0-py3-none-any.whl\pip\_internal\cli\req_command.py", line 95, in get_default_session CAQuietExec64: self._session = self.enter_context(self._build_session(options)) CAQuietExec64: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ CAQuietExec64: File "C:\Users\EDM115\AppData\Local\Temp\tmphbeisq9d\pip-24.0-py3-none-any.whl\pip\_internal\cli\req_command.py", line 122, in _build_session CAQuietExec64: session = PipSession( CAQuietExec64: ^^^^^^^^^^^ CAQuietExec64: File "C:\Users\EDM115\AppData\Local\Temp\tmphbeisq9d\pip-24.0-py3-none-any.whl\pip\_internal\network\session.py", line 342, in __init__ CAQuietExec64: self.headers = user_agent() CAQuietExec64: ^^^^^^^^^^^^ CAQuietExec64: File "C:\Users\EDM115\AppData\Local\Temp\tmphbeisq9d\pip-24.0-py3-none-any.whl\pip\_internal\network\session.py", line 175, in user_agent CAQuietExec64: setuptools_dist = get_default_environment().get_distribution("setuptools") CAQuietExec64: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ CAQuietExec64: File "C:\Users\EDM115\AppData\Local\Temp\tmphbeisq9d\pip-24.0-py3-none-any.whl\pip\_internal\metadata\importlib\_envs.py", line 189, in get_distribution CAQuietExec64: return next(matches, None) CAQuietExec64: ^^^^^^^^^^^^^^^^^^^ CAQuietExec64: File "C:\Users\EDM115\AppData\Local\Temp\tmphbeisq9d\pip-24.0-py3-none-any.whl\pip\_internal\metadata\importlib\_envs.py", line 184, in <genexpr> CAQuietExec64: matches = ( CAQuietExec64: ^ CAQuietExec64: File "C:\Users\EDM115\AppData\Local\Temp\tmphbeisq9d\pip-24.0-py3-none-any.whl\pip\_internal\metadata\base.py", line 626, in iter_all_distributions CAQuietExec64: for dist in self._iter_distributions(): CAQuietExec64: File "C:\Users\EDM115\AppData\Local\Temp\tmphbeisq9d\pip-24.0-py3-none-any.whl\pip\_internal\metadata\importlib\_envs.py", line 181, in _iter_distributions CAQuietExec64: yield from finder.find_linked(location) CAQuietExec64: File "C:\Users\EDM115\AppData\Local\Temp\tmphbeisq9d\pip-24.0-py3-none-any.whl\pip\_internal\metadata\importlib\_envs.py", line 96, in find_linked CAQuietExec64: if not path.is_dir(): CAQuietExec64: ^^^^^^^^^^^^^ CAQuietExec64: File "D:\EDM115\Programmes\Python312\Lib\pathlib.py", line 875, in is_dir CAQuietExec64: return S_ISDIR(self.stat().st_mode) CAQuietExec64: ^^^^^^^^^^^ CAQuietExec64: File "D:\EDM115\Programmes\Python312\Lib\pathlib.py", line 840, in stat CAQuietExec64: return os.stat(self, follow_symlinks=follow_symlinks) CAQuietExec64: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ CAQuietExec64: OSError: Le chemin d’accès ne peut pas être parcouru car il contient un point de montage non approuvé: 'C:\\Program Files\\Csound6_x64\\bin' CAQuietExec64: Traceback (most recent call last): CAQuietExec64: File "<frozen runpy>", line 198, in _run_module_as_main CAQuietExec64: File "<frozen runpy>", line 88, in _run_code CAQuietExec64: File "D:\EDM115\Programmes\Python312\Lib\ensurepip\__main__.py", line 5, in <module> CAQuietExec64: sys.exit(ensurepip._main()) CAQuietExec64: ^^^^^^^^^^^^^^^^^ CAQuietExec64: File "D:\EDM115\Programmes\Python312\Lib\ensurepip\__init__.py", line 284, in _main CAQuietExec64: return _bootstrap( CAQuietExec64: ^^^^^^^^^^^ CAQuietExec64: File "D:\EDM115\Programmes\Python312\Lib\ensurepip\__init__.py", line 200, in _bootstrap CAQuietExec64: return _run_pip(, additional_paths) CAQuietExec64: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ CAQuietExec64: File "D:\EDM115\Programmes\Python312\Lib\ensurepip\__init__.py", line 101, in _run_pip CAQuietExec64: return subprocess.run(cmd, check=True).returncode CAQuietExec64: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ CAQuietExec64: File "D:\EDM115\Programmes\Python312\Lib\subprocess.py", line 571, in run CAQuietExec64: raise CalledProcessError(retcode, process.args, CAQuietExec64: subprocess.CalledProcessError: Command ' + sys.path\nsys.argv = '\nrunpy.run_module("pip", run_name="__main__", alter_sys=True)\n']' returned non-zero exit status 2. CAQuietExec64: Error 0x80070001: Command line returned an error. CAQuietExec64: Error 0x80070001: QuietExec64 Failed CAQuietExec64: Error 0x80070001: Failed in ExecCommon64 methodThe exception
OSError: Le chemin d’accès ne peut pas être parcouru car il contient un point de montage non approuvé: 'C:\\Program Files\\Csound6_x64\\bin'translates as "The path cannot be traversed because it contains an untrusted mount point".It appears that Csound6_x64's installer overrides the global
PYTHONPATHenvironment variable, and while we tell Python to ignore this when we run the ensurepip command, it looks like they start a new child process which doesn't ignore it. And because it's running as an installer, it gets blocked, probably as part of a security fix in Windows (this is why it works when you run ensurepip yourself).Probably we can just make
ensurepipclearPYTHONPATHitself before launching any new copies of Python, though there may be a deeper fix that's possible in pip to also avoid this issue.I also need to take a closer look at why precompiling pyc files failed. There's not enough output here to see.
[2FF0:2F08][2024-04-03T14:34:56]i301: Applying execute package: compileall_AllUsers, action: Install, path: C:\ProgramData\Package Cache\29104347204BF2D95418EA28730B788408D036EB\py.exe, arguments: '"C:\ProgramData\Package Cache\29104347204BF2D95418EA28730B788408D036EB\py.exe" -3.12 -E -s -Wi "D:\EDM115\Programmes\Python312\Lib\compileall.py" -f -x "bad_coding|badsyntax|site-packages|py2_|lib2to3\\tests|venv\\scripts" "D:\EDM115\Programmes\Python312\Lib"' [2FF0:2F08][2024-04-03T14:35:05]e000: Error 0x80070001: Process returned error: 0x1 [2FF0:2F08][2024-04-03T14:35:05]e000: Error 0x80070001: Failed to execute EXE package. [3478:09C0][2024-04-03T14:35:05]e000: Error 0x80070001: Failed to configure per-machine EXE package. [3478:09C0][2024-04-03T14:35:05]w350: Applied non-vital package: compileall_AllUsers, encountered error: 0x80070001. Continuing... [2FF0:2F08][2024-04-03T14:35:05]i301: Applying execute package: compileallO_AllUsers, action: Install, path: C:\ProgramData\Package Cache\29104347204BF2D95418EA28730B788408D036EB\py.exe, arguments: '"C:\ProgramData\Package Cache\29104347204BF2D95418EA28730B788408D036EB\py.exe" -3.12 -O -E -s -Wi "D:\EDM115\Programmes\Python312\Lib\compileall.py" -f -x "bad_coding|badsyntax|site-packages|py2_|lib2to3\\tests|venv\\scripts" "D:\EDM115\Programmes\Python312\Lib"' [2FF0:2F08][2024-04-03T14:35:15]e000: Error 0x80070001: Process returned error: 0x1 [2FF0:2F08][2024-04-03T14:35:15]e000: Error 0x80070001: Failed to execute EXE package. [3478:09C0][2024-04-03T14:35:15]e000: Error 0x80070001: Failed to configure per-machine EXE package. [3478:09C0][2024-04-03T14:35:15]w350: Applied non-vital package: compileallO_AllUsers, encountered error: 0x80070001. Continuing... [2FF0:2F08][2024-04-03T14:35:15]i301: Applying execute package: compileallOO_AllUsers, action: Install, path: C:\ProgramData\Package Cache\29104347204BF2D95418EA28730B788408D036EB\py.exe, arguments: '"C:\ProgramData\Package Cache\29104347204BF2D95418EA28730B788408D036EB\py.exe" -3.12 -OO -E -s -Wi "D:\EDM115\Programmes\Python312\Lib\compileall.py" -f -x "bad_coding|badsyntax|site-packages|py2_|lib2to3\\tests|venv\\scripts" "D:\EDM115\Programmes\Python312\Lib"' [2FF0:2F08][2024-04-03T14:35:25]e000: Error 0x80070001: Process returned error: 0x1 [2FF0:2F08][2024-04-03T14:35:25]e000: Error 0x80070001: Failed to execute EXE package. [3478:09C0][2024-04-03T14:35:25]e000: Error 0x80070001: Failed to configure per-machine EXE package. [3478:09C0][2024-04-03T14:35:25]w350: Applied non-vital package: compileallOO_AllUsers, encountered error: 0x80070001. Continuing...Actually, the heart of the matter is really in
pathlib:CAQuietExec64: File "C:\Users\EDM115\AppData\Local\Temp\tmphbeisq9d\pip-24.0-py3-none-any.whl\pip\_internal\metadata\importlib\_envs.py", line 96, in find_linked CAQuietExec64: if not path.is_dir(): CAQuietExec64: ^^^^^^^^^^^^^ CAQuietExec64: File "D:\EDM115\Programmes\Python312\Lib\pathlib.py", line 875, in is_dir CAQuietExec64: return S_ISDIR(self.stat().st_mode) CAQuietExec64: ^^^^^^^^^^^ CAQuietExec64: File "D:\EDM115\Programmes\Python312\Lib\pathlib.py", line 840, in stat CAQuietExec64: return os.stat(self, follow_symlinks=follow_symlinks) CAQuietExec64: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ CAQuietExec64: OSError: Le chemin d’accès ne peut pas être parcouru car il contient un point de montage non approuvé: 'C:\\Program Files\\Csound6_x64\\bin'@barneygale We're not supposed to ever raise exceptions through
is_dircalls, right? (Exception message is "The path cannot be traversed because it contains an untrusted mount point" as I mentioned in the earlier reply)It appears that Csound6_x64's installer overrides the global PYTHONPATH environment variable
It indeed does :
What is Csound ? I couldn't tell you. Why I have it ? idk either, but I do music production and I believe that there's one VST I installed that depends on it and installed itI do music production as well (mostly mixing) and also coding so I'm kinda interested to figure out what it does 😆 Looks like it could be fun
But chances are you can delete the variable and the install should be fine after that. We can also make fixes upstream as well, though.
also an interesting thing : the path to Csound (
C:\Program Files\Csound6_x64) isn't a folder, but a symlink (of a symlink)around a year ago I moved most stuff from my primary drive to the secondary (links to
D:\EDM115\Programmes\Programs\Csound6_x64)
months later, upon a yearly pc cleanup, i moved a lot of folders to an external drive (F:\Symlinks\Programs\Csound6_x64)
mind you, the drive F wasn't plugged in when installing python, so that folder was anyway unreachableisn't a folder, but a symlink
This will be why Windows Installer was blocked from accessing it - this is a typical pattern used by attackers to intercept legitimate installers. Probably it works okay if the path is "normal".
I just ran into this issue as well. I think there's a broader problem here. I've tested with 3.12 here, but the issue exists at least as far back as 3.8.
Minimal steps to reproduce on a fresh Windows 11 installation
Preparation
The goal here is to get pip installed in the Python 3.12 user site-packages without having Python 3.12 installed at the end of the process. These steps are a bit contrived because I couldn't figure out how to get into this state naturally, but I've seen it in the field.
- Install Python 3.12.3 using this installer. Just click the "Install Now" button.
- Install pip into user site-packages:
> py -3.12 -m pip install --ignore-installed --user pip Collecting pip Downloading pip-24.0-py3-none-any.whl.metadata (3.6 kB) Downloading pip-24.0-py3-none-any.whl (2.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 6.4 MB/s eta 0:00:00 Installing collected packages: pip Successfully installed pip-24.0- Temporarily rename the user site-packages to preserve it during uninstall. This shouldn't be necessary, but the uninstall ends up uninstalling pip from the user site-packages (instead of the system Python) due to this bug.
mv C:\Users\user\AppData\Roaming\Python\Python312 C:\Users\user\AppData\Roaming\Python\Python312bak- Uninstall Python 3.12.3.
- Rename the user site-packages back:
mv C:\Users\user\AppData\Roaming\Python\Python312bak C:\Users\user\AppData\Roaming\Python\Python312Reproduction
- Install Python 3.12.3 again using this installer. Just click the "Install Now" button.
- The installation logs show that pip wasn't installed as expected:
MSI (s) (B8:28) [16:18:35:436]: Executing op: CustomActionSchedule(Action=UpdatePip,ActionType=1089,Source=BinaryData,Target=CAQuietExec64,CustomActionData="C:\Users\user\AppData\Local\Programs\Python\Python312\python.exe" -E -s -m ensurepip -U --default-pip) MSI (s) (B8:40) [16:18:35:443]: Invoking remote custom action. DLL: C:\Windows\Installer\MSI4763.tmp, Entrypoint: CAQuietExec64 MSI (s) (B8:90) [16:18:35:443]: Generating random cookie. MSI (s) (B8:90) [16:18:35:462]: Created Custom Action Server with PID 1584 (0x630). MSI (s) (B8:C0) [16:18:35:479]: Running as a service. MSI (s) (B8:C0) [16:18:35:479]: Hello, I'm your 32bit Impersonated custom action server. CAQuietExec64: Looking in links: c:\Users\user\AppData\Local\Temp\tmpbvvknrmu MSI (s) (B8:28) [16:18:41:996]: Executing op: End(Checksum=0,ProgressTotalHDWord=0,ProgressTotalLDWord=311632) CAQuietExec64: Requirement already satisfied: pip in c:\users\user\appdata\roaming\python\python312\site-packages (24.0)- Verify that pip isn't installed in the system site-packages, but is still present in the user site-packages:
> py -3.12 -E -s -m pip -h C:\Users\user\AppData\Local\Programs\Python\Python312\python.exe: No module named pip > ls C:\Users\user\AppData\Local\Programs\Python\Python312\Lib\site-packages README.txt > ls C:\Users\user\AppData\Roaming\Python\Python312\site-packages pip pip-24.0.dist-info- Trying to install pip using the same method as the installer fails with the same message:
> C:\Users\user\AppData\Local\Programs\Python\Python312\python.exe -E -s -m ensurepip -U --default-pip Looking in links: c:\Users\user\AppData\Local\Temp\tmpwljdworl Requirement already satisfied: pip in c:\users\user\appdata\roaming\python\python312\site-packages (24.0)Analysis
The
-sin the ensurepip invocation tells Python to ignore the user site-packages, but ensurepip launches its own subprocess to run pip and loses the-E -sflags in the process. This was fixed from the ensurepip side in #90355, but that fix specifically propagates the-Iisolated mode flag, which is not fully enabled by the-E -sflags that the installer uses.There may be a similar issue here: https://github.com/python/cpython/blob/v3.12.3/Mac/BuildScript/scripts/postflight.ensurepip#L13
Thanks @Vynce for the analysis. This is a very different root cause from the original report on this bug, but it's certainly viable.
Given I don't think we can do anything specific about the original problem, as we don't control Windows Installer's security enforcement, I'm fine with reusing the issue number for
ensurepipnot propagating those two flags. Arguably,ensurepipshould always run its subprocess with-Eand possibly with-sas the intent is probably not to install into user-site packages.(@pradyunsg FYI, or if you have another idea)
I left a question about whether
ensurepipshould always use-E -s, but that can be answered even after the issue is closed.Reacted by EDM115
Bug report
Bug description:
I recently did a fresh python installation, from python.org (https://www.python.org/ftp/python/3.12.2/python-3.12.2-amd64.exe)
I did installed it on an "uncommon" directory (
D:\EDM115\Programmes\Python312\), but this had never caused any issue in the past.The main issue is that the
Scriptsfolder was simply empty, meaning that no pip command worked. I verified that the pip checkbox was checked, tried to repair and later redo the install, only to face the same issues.What fixed it was to run
py -m ensurepip --upgradeand later renameD:\EDM115\Programmes\Python312\Scripts\pip3.exetoD:\EDM115\Programmes\Python312\Scripts\pip.exe, but I believe that it should be done automaticallyCPython versions tested on:
3.12
Operating systems tested on:
Windows
Linked PRs