PythonのNVIDIA/apexがwindowsインストールできなかったのでメモ

クロガネです。
こちらのもインストールで躓いたので知見を共有します。
NVIDIA/apexは某Apexではなく、nVidia製のPyTorch用Extensionです。

基本的な導入方法

NVIDIA/apex: A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch (github.com)
基本はこちらの[Experimental] Windowsに従えばOKのはずです。

まずはドキュメント通り、gitでクローンして、windows用のインストールコマンドを打ちます。

git clone https://github.com/NVIDIA/apex.git
cd apex

多くの場合は下記のどちらかで成功するらしいです。

pip install -v --disable-pip-version-check --no-cache-dir --no-build-isolation --config-settings "--build-option=--cpp_ext" --config-settings "--build-option=--cuda_ext" .

pip install -v --no-cache-dir .

上手くいかなかったときの解決策

これでいけるらしいですが、自環境ではpackagingモジュールが求められました。

python -m pip install packaging

なのでpipから入れましたが、packagingモジュールの導入後も同様にエラーが生じました。

(tracking) F:\devs\tarckanything\apex>pip install packaging
Defaulting to user installation because normal site-packages is not writeable
Requirement already satisfied: packaging in c:\program files\python310\lib\site-packages (23.2)
WARNING: There was an error checking the latest version of pip.

(tracking) F:\devs\tarckanything\apex>pip install -v --no-cache-dir .
Using pip 23.0.1 from C:\Program Files\Python310\lib\site-packages\pip (python 3.10)
Defaulting to user installation because normal site-packages is not writeable
Processing f:\devs\tarckanything\apex
  Running command pip subprocess to install build dependencies
  Collecting setuptools
    Using cached setuptools-70.0.0-py3-none-any.whl (863 kB)
  Collecting wheel
    Using cached wheel-0.43.0-py3-none-any.whl (65 kB)
  Installing collected packages: wheel, setuptools
  Successfully installed setuptools-70.0.0 wheel-0.43.0
  WARNING: There was an error checking the latest version of pip.
  Installing build dependencies ... done
  Running command Getting requirements to build wheel
  Traceback (most recent call last):
    File "C:\Program Files\Python310\lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 353, in <module>
      main()
    File "C:\Program Files\Python310\lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 335, in main
      json_out['return_val'] = hook(**hook_input['kwargs'])
    File "C:\Program Files\Python310\lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 118, in get_requires_for_build_wheel
      return hook(config_settings)
    File "C:\Users\himak\AppData\Local\Temp\pip-build-env-85p3hp7a\overlay\Lib\site-packages\setuptools\build_meta.py", line 325, in get_requires_for_build_wheel
      return self._get_build_requires(config_settings, requirements=['wheel'])
    File "C:\Users\himak\AppData\Local\Temp\pip-build-env-85p3hp7a\overlay\Lib\site-packages\setuptools\build_meta.py", line 295, in _get_build_requires
      self.run_setup()
    File "C:\Users\himak\AppData\Local\Temp\pip-build-env-85p3hp7a\overlay\Lib\site-packages\setuptools\build_meta.py", line 311, in run_setup
      exec(code, locals())
    File "<string>", line 5, in <module>
  ModuleNotFoundError: No module named 'packaging'
  error: subprocess-exited-with-error

  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> See above for output.

  note: This error originates from a subprocess, and is likely not a problem with pip.
  full command: 'C:\Program Files\Python310\python.exe' 'C:\Program Files\Python310\lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py' get_requires_for_build_wheel 'C:\Users\himak\AppData\Local\Temp\tmpru8auhv0'
  cwd: F:\devs\tarckanything\apex
  Getting requirements to build wheel ... error
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

その場合、インストールコマンドに--no-build-isolationオプションを追加すればうまくいくこともあるようです。
can't install apex · Issue #1594 · NVIDIA/apex (github.com)

python -m pip install -v --no-cache-dir --no-build-isolation .

こちらのコマンドをapexディレクトリで実行したところ、正常にインストールが完了しました(長いですが末尾にログは貼ってきます)。

お疲れ様です！
Windows環境だと、いろいろ入れるとめちゃくちゃインストールミスりますね。結局ほとんどの場合、issueを見れば解決しますが、初心者のことは自分もissueが全く分からなかったのでぜひ解決につながればと思います。

それでは、クロガネでした！
役に立てばぜひいいねを！

参考) apexがうまくインストールできた時の実行結果

メモ程度に。参考になれば幸いです。

(tracking) F:\devs\tarckanything\apex>python -m pip install -v --no-cache-dir --no-build-isolation .
Using pip 23.0.1 from C:\Program Files\Python310\lib\site-packages\pip (python 3.10)
Processing f:\devs\tarckanything\apex
  Running command Preparing metadata (pyproject.toml)


  torch.__version__  = 2.2.2+cu118


  running dist_info
  creating C:\Users\himak\AppData\Local\Temp\pip-modern-metadata-8dt4qyeg\apex.egg-info
  writing C:\Users\himak\AppData\Local\Temp\pip-modern-metadata-8dt4qyeg\apex.egg-info\PKG-INFO
  writing dependency_links to C:\Users\himak\AppData\Local\Temp\pip-modern-metadata-8dt4qyeg\apex.egg-info\dependency_links.txt
  writing requirements to C:\Users\himak\AppData\Local\Temp\pip-modern-metadata-8dt4qyeg\apex.egg-info\requires.txt
  writing top-level names to C:\Users\himak\AppData\Local\Temp\pip-modern-metadata-8dt4qyeg\apex.egg-info\top_level.txt
  writing manifest file 'C:\Users\himak\AppData\Local\Temp\pip-modern-metadata-8dt4qyeg\apex.egg-info\SOURCES.txt'
  reading manifest file 'C:\Users\himak\AppData\Local\Temp\pip-modern-metadata-8dt4qyeg\apex.egg-info\SOURCES.txt'
  adding license file 'LICENSE'
  writing manifest file 'C:\Users\himak\AppData\Local\Temp\pip-modern-metadata-8dt4qyeg\apex.egg-info\SOURCES.txt'
  creating 'C:\Users\himak\AppData\Local\Temp\pip-modern-metadata-8dt4qyeg\apex-0.1.dist-info'
  Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: packaging>20.6 in c:\program files\python310\lib\site-packages (from apex==0.1) (24.0)
Building wheels for collected packages: apex
  Running command Building wheel for apex (pyproject.toml)


  torch.__version__  = 2.2.2+cu118


  running bdist_wheel
  running build
  running build_py
  creating build\lib
  creating build\lib\apex
  copying apex\_autocast_utils.py -> build\lib\apex
  copying apex\__init__.py -> build\lib\apex
  creating build\lib\apex\amp
  copying apex\amp\amp.py -> build\lib\apex\amp
  copying apex\amp\compat.py -> build\lib\apex\amp
  copying apex\amp\frontend.py -> build\lib\apex\amp
  copying apex\amp\handle.py -> build\lib\apex\amp
  copying apex\amp\opt.py -> build\lib\apex\amp
  copying apex\amp\rnn_compat.py -> build\lib\apex\amp
  copying apex\amp\scaler.py -> build\lib\apex\amp
  copying apex\amp\utils.py -> build\lib\apex\amp
  copying apex\amp\wrap.py -> build\lib\apex\amp
  copying apex\amp\_amp_state.py -> build\lib\apex\amp
  copying apex\amp\_initialize.py -> build\lib\apex\amp
  copying apex\amp\_process_optimizer.py -> build\lib\apex\amp
  copying apex\amp\__init__.py -> build\lib\apex\amp
  copying apex\amp\__version__.py -> build\lib\apex\amp
  creating build\lib\apex\contrib
  copying apex\contrib\__init__.py -> build\lib\apex\contrib
  creating build\lib\apex\fp16_utils
  copying apex\fp16_utils\fp16util.py -> build\lib\apex\fp16_utils
  copying apex\fp16_utils\fp16_optimizer.py -> build\lib\apex\fp16_utils
  copying apex\fp16_utils\loss_scaler.py -> build\lib\apex\fp16_utils
  copying apex\fp16_utils\__init__.py -> build\lib\apex\fp16_utils
  creating build\lib\apex\fused_dense
  copying apex\fused_dense\fused_dense.py -> build\lib\apex\fused_dense
  copying apex\fused_dense\__init__.py -> build\lib\apex\fused_dense
  creating build\lib\apex\mlp
  copying apex\mlp\mlp.py -> build\lib\apex\mlp
  copying apex\mlp\__init__.py -> build\lib\apex\mlp
  creating build\lib\apex\multi_tensor_apply
  copying apex\multi_tensor_apply\multi_tensor_apply.py -> build\lib\apex\multi_tensor_apply
  copying apex\multi_tensor_apply\__init__.py -> build\lib\apex\multi_tensor_apply
  creating build\lib\apex\normalization
  copying apex\normalization\fused_layer_norm.py -> build\lib\apex\normalization
  copying apex\normalization\__init__.py -> build\lib\apex\normalization
  creating build\lib\apex\optimizers
  copying apex\optimizers\fused_adagrad.py -> build\lib\apex\optimizers
  copying apex\optimizers\fused_adam.py -> build\lib\apex\optimizers
  copying apex\optimizers\fused_lamb.py -> build\lib\apex\optimizers
  copying apex\optimizers\fused_mixed_precision_lamb.py -> build\lib\apex\optimizers
  copying apex\optimizers\fused_novograd.py -> build\lib\apex\optimizers
  copying apex\optimizers\fused_sgd.py -> build\lib\apex\optimizers
  copying apex\optimizers\__init__.py -> build\lib\apex\optimizers
  creating build\lib\apex\parallel
  copying apex\parallel\distributed.py -> build\lib\apex\parallel
  copying apex\parallel\LARC.py -> build\lib\apex\parallel
  copying apex\parallel\multiproc.py -> build\lib\apex\parallel
  copying apex\parallel\optimized_sync_batchnorm.py -> build\lib\apex\parallel
  copying apex\parallel\optimized_sync_batchnorm_kernel.py -> build\lib\apex\parallel
  copying apex\parallel\sync_batchnorm.py -> build\lib\apex\parallel
  copying apex\parallel\sync_batchnorm_kernel.py -> build\lib\apex\parallel
  copying apex\parallel\__init__.py -> build\lib\apex\parallel
  creating build\lib\apex\RNN
  copying apex\RNN\cells.py -> build\lib\apex\RNN
  copying apex\RNN\models.py -> build\lib\apex\RNN
  copying apex\RNN\RNNBackend.py -> build\lib\apex\RNN
  copying apex\RNN\__init__.py -> build\lib\apex\RNN
  creating build\lib\apex\transformer
  copying apex\transformer\enums.py -> build\lib\apex\transformer
  copying apex\transformer\log_util.py -> build\lib\apex\transformer
  copying apex\transformer\microbatches.py -> build\lib\apex\transformer
  copying apex\transformer\parallel_state.py -> build\lib\apex\transformer
  copying apex\transformer\utils.py -> build\lib\apex\transformer
  copying apex\transformer\_ucc_util.py -> build\lib\apex\transformer
  copying apex\transformer\__init__.py -> build\lib\apex\transformer
  creating build\lib\apex\amp\lists
  copying apex\amp\lists\functional_overrides.py -> build\lib\apex\amp\lists
  copying apex\amp\lists\tensor_overrides.py -> build\lib\apex\amp\lists
  copying apex\amp\lists\torch_overrides.py -> build\lib\apex\amp\lists
  copying apex\amp\lists\__init__.py -> build\lib\apex\amp\lists
  creating build\lib\apex\contrib\bottleneck
  copying apex\contrib\bottleneck\bottleneck.py -> build\lib\apex\contrib\bottleneck
  copying apex\contrib\bottleneck\halo_exchangers.py -> build\lib\apex\contrib\bottleneck
  copying apex\contrib\bottleneck\test.py -> build\lib\apex\contrib\bottleneck
  copying apex\contrib\bottleneck\__init__.py -> build\lib\apex\contrib\bottleneck
  creating build\lib\apex\contrib\clip_grad
  copying apex\contrib\clip_grad\clip_grad.py -> build\lib\apex\contrib\clip_grad
  copying apex\contrib\clip_grad\__init__.py -> build\lib\apex\contrib\clip_grad
  creating build\lib\apex\contrib\conv_bias_relu
  copying apex\contrib\conv_bias_relu\conv_bias_relu.py -> build\lib\apex\contrib\conv_bias_relu
  copying apex\contrib\conv_bias_relu\__init__.py -> build\lib\apex\contrib\conv_bias_relu
  creating build\lib\apex\contrib\cudnn_gbn
  copying apex\contrib\cudnn_gbn\batch_norm.py -> build\lib\apex\contrib\cudnn_gbn
  copying apex\contrib\cudnn_gbn\__init__.py -> build\lib\apex\contrib\cudnn_gbn
  creating build\lib\apex\contrib\fmha
  copying apex\contrib\fmha\fmha.py -> build\lib\apex\contrib\fmha
  copying apex\contrib\fmha\__init__.py -> build\lib\apex\contrib\fmha
  creating build\lib\apex\contrib\focal_loss
  copying apex\contrib\focal_loss\focal_loss.py -> build\lib\apex\contrib\focal_loss
  copying apex\contrib\focal_loss\__init__.py -> build\lib\apex\contrib\focal_loss
  creating build\lib\apex\contrib\gpu_direct_storage
  copying apex\contrib\gpu_direct_storage\__init__.py -> build\lib\apex\contrib\gpu_direct_storage
  creating build\lib\apex\contrib\groupbn
  copying apex\contrib\groupbn\batch_norm.py -> build\lib\apex\contrib\groupbn
  copying apex\contrib\groupbn\__init__.py -> build\lib\apex\contrib\groupbn
  creating build\lib\apex\contrib\group_norm
  copying apex\contrib\group_norm\group_norm.py -> build\lib\apex\contrib\group_norm
  copying apex\contrib\group_norm\__init__.py -> build\lib\apex\contrib\group_norm
  creating build\lib\apex\contrib\index_mul_2d
  copying apex\contrib\index_mul_2d\index_mul_2d.py -> build\lib\apex\contrib\index_mul_2d
  copying apex\contrib\index_mul_2d\__init__.py -> build\lib\apex\contrib\index_mul_2d
  creating build\lib\apex\contrib\layer_norm
  copying apex\contrib\layer_norm\layer_norm.py -> build\lib\apex\contrib\layer_norm
  copying apex\contrib\layer_norm\__init__.py -> build\lib\apex\contrib\layer_norm
  creating build\lib\apex\contrib\multihead_attn
  copying apex\contrib\multihead_attn\encdec_multihead_attn.py -> build\lib\apex\contrib\multihead_attn
  copying apex\contrib\multihead_attn\encdec_multihead_attn_func.py -> build\lib\apex\contrib\multihead_attn
  copying apex\contrib\multihead_attn\fast_encdec_multihead_attn_func.py -> build\lib\apex\contrib\multihead_attn
  copying apex\contrib\multihead_attn\fast_encdec_multihead_attn_norm_add_func.py -> build\lib\apex\contrib\multihead_attn
  copying apex\contrib\multihead_attn\fast_self_multihead_attn_func.py -> build\lib\apex\contrib\multihead_attn
  copying apex\contrib\multihead_attn\fast_self_multihead_attn_norm_add_func.py -> build\lib\apex\contrib\multihead_attn
  copying apex\contrib\multihead_attn\mask_softmax_dropout_func.py -> build\lib\apex\contrib\multihead_attn
  copying apex\contrib\multihead_attn\self_multihead_attn.py -> build\lib\apex\contrib\multihead_attn
  copying apex\contrib\multihead_attn\self_multihead_attn_func.py -> build\lib\apex\contrib\multihead_attn
  copying apex\contrib\multihead_attn\__init__.py -> build\lib\apex\contrib\multihead_attn
  creating build\lib\apex\contrib\nccl_allocator
  copying apex\contrib\nccl_allocator\nccl_allocator.py -> build\lib\apex\contrib\nccl_allocator
  copying apex\contrib\nccl_allocator\__init__.py -> build\lib\apex\contrib\nccl_allocator
  creating build\lib\apex\contrib\openfold_triton
  copying apex\contrib\openfold_triton\fused_adam_swa.py -> build\lib\apex\contrib\openfold_triton
  copying apex\contrib\openfold_triton\layer_norm.py -> build\lib\apex\contrib\openfold_triton
  copying apex\contrib\openfold_triton\mha.py -> build\lib\apex\contrib\openfold_triton
  copying apex\contrib\openfold_triton\_layer_norm_backward_kernels.py -> build\lib\apex\contrib\openfold_triton
  copying apex\contrib\openfold_triton\_layer_norm_config_ampere.py -> build\lib\apex\contrib\openfold_triton
  copying apex\contrib\openfold_triton\_layer_norm_config_hopper.py -> build\lib\apex\contrib\openfold_triton
  copying apex\contrib\openfold_triton\_layer_norm_forward_kernels.py -> build\lib\apex\contrib\openfold_triton
  copying apex\contrib\openfold_triton\_mha_kernel.py -> build\lib\apex\contrib\openfold_triton
  copying apex\contrib\openfold_triton\__init__.py -> build\lib\apex\contrib\openfold_triton
  creating build\lib\apex\contrib\optimizers
  copying apex\contrib\optimizers\distributed_fused_adam.py -> build\lib\apex\contrib\optimizers
  copying apex\contrib\optimizers\distributed_fused_lamb.py -> build\lib\apex\contrib\optimizers
  copying apex\contrib\optimizers\fp16_optimizer.py -> build\lib\apex\contrib\optimizers
  copying apex\contrib\optimizers\fused_adam.py -> build\lib\apex\contrib\optimizers
  copying apex\contrib\optimizers\fused_lamb.py -> build\lib\apex\contrib\optimizers
  copying apex\contrib\optimizers\fused_sgd.py -> build\lib\apex\contrib\optimizers
  copying apex\contrib\optimizers\__init__.py -> build\lib\apex\contrib\optimizers
  creating build\lib\apex\contrib\peer_memory
  copying apex\contrib\peer_memory\peer_halo_exchanger_1d.py -> build\lib\apex\contrib\peer_memory
  copying apex\contrib\peer_memory\peer_memory.py -> build\lib\apex\contrib\peer_memory
  copying apex\contrib\peer_memory\__init__.py -> build\lib\apex\contrib\peer_memory
  creating build\lib\apex\contrib\sparsity
  copying apex\contrib\sparsity\asp.py -> build\lib\apex\contrib\sparsity
  copying apex\contrib\sparsity\permutation_lib.py -> build\lib\apex\contrib\sparsity
  copying apex\contrib\sparsity\sparse_masklib.py -> build\lib\apex\contrib\sparsity
  copying apex\contrib\sparsity\__init__.py -> build\lib\apex\contrib\sparsity
  creating build\lib\apex\contrib\test
  copying apex\contrib\test\__init__.py -> build\lib\apex\contrib\test
  creating build\lib\apex\contrib\transducer
  copying apex\contrib\transducer\transducer.py -> build\lib\apex\contrib\transducer
  copying apex\contrib\transducer\_transducer_ref.py -> build\lib\apex\contrib\transducer
  copying apex\contrib\transducer\__init__.py -> build\lib\apex\contrib\transducer
  creating build\lib\apex\contrib\xentropy
  copying apex\contrib\xentropy\softmax_xentropy.py -> build\lib\apex\contrib\xentropy
  copying apex\contrib\xentropy\__init__.py -> build\lib\apex\contrib\xentropy
  creating build\lib\apex\contrib\sparsity\permutation_search_kernels
  copying apex\contrib\sparsity\permutation_search_kernels\call_permutation_search_kernels.py -> build\lib\apex\contrib\sparsity\permutation_search_kernels
  copying apex\contrib\sparsity\permutation_search_kernels\channel_swap.py -> build\lib\apex\contrib\sparsity\permutation_search_kernels
  copying apex\contrib\sparsity\permutation_search_kernels\exhaustive_search.py -> build\lib\apex\contrib\sparsity\permutation_search_kernels
  copying apex\contrib\sparsity\permutation_search_kernels\permutation_utilities.py -> build\lib\apex\contrib\sparsity\permutation_search_kernels
  copying apex\contrib\sparsity\permutation_search_kernels\__init__.py -> build\lib\apex\contrib\sparsity\permutation_search_kernels
  creating build\lib\apex\contrib\test\bottleneck
  copying apex\contrib\test\bottleneck\test_bottleneck_module.py -> build\lib\apex\contrib\test\bottleneck
  copying apex\contrib\test\bottleneck\__init__.py -> build\lib\apex\contrib\test\bottleneck
  creating build\lib\apex\contrib\test\clip_grad
  copying apex\contrib\test\clip_grad\test_clip_grad.py -> build\lib\apex\contrib\test\clip_grad
  copying apex\contrib\test\clip_grad\__init__.py -> build\lib\apex\contrib\test\clip_grad
  creating build\lib\apex\contrib\test\conv_bias_relu
  copying apex\contrib\test\conv_bias_relu\test_conv_bias_relu.py -> build\lib\apex\contrib\test\conv_bias_relu
  copying apex\contrib\test\conv_bias_relu\__init__.py -> build\lib\apex\contrib\test\conv_bias_relu
  creating build\lib\apex\contrib\test\cudnn_gbn
  copying apex\contrib\test\cudnn_gbn\test_cudnn_gbn_with_two_gpus.py -> build\lib\apex\contrib\test\cudnn_gbn
  copying apex\contrib\test\cudnn_gbn\__init__.py -> build\lib\apex\contrib\test\cudnn_gbn
  creating build\lib\apex\contrib\test\fmha
  copying apex\contrib\test\fmha\test_fmha.py -> build\lib\apex\contrib\test\fmha
  copying apex\contrib\test\fmha\__init__.py -> build\lib\apex\contrib\test\fmha
  creating build\lib\apex\contrib\test\focal_loss
  copying apex\contrib\test\focal_loss\test_focal_loss.py -> build\lib\apex\contrib\test\focal_loss
  copying apex\contrib\test\focal_loss\__init__.py -> build\lib\apex\contrib\test\focal_loss
  creating build\lib\apex\contrib\test\group_norm
  copying apex\contrib\test\group_norm\test_group_norm.py -> build\lib\apex\contrib\test\group_norm
  copying apex\contrib\test\group_norm\__init__.py -> build\lib\apex\contrib\test\group_norm
  creating build\lib\apex\contrib\test\index_mul_2d
  copying apex\contrib\test\index_mul_2d\test_index_mul_2d.py -> build\lib\apex\contrib\test\index_mul_2d
  copying apex\contrib\test\index_mul_2d\__init__.py -> build\lib\apex\contrib\test\index_mul_2d
  creating build\lib\apex\contrib\test\layer_norm
  copying apex\contrib\test\layer_norm\test_fast_layer_norm.py -> build\lib\apex\contrib\test\layer_norm
  copying apex\contrib\test\layer_norm\__init__.py -> build\lib\apex\contrib\test\layer_norm
  creating build\lib\apex\contrib\test\multihead_attn
  copying apex\contrib\test\multihead_attn\test_encdec_multihead_attn.py -> build\lib\apex\contrib\test\multihead_attn
  copying apex\contrib\test\multihead_attn\test_encdec_multihead_attn_norm_add.py -> build\lib\apex\contrib\test\multihead_attn
  copying apex\contrib\test\multihead_attn\test_fast_self_multihead_attn_bias.py -> build\lib\apex\contrib\test\multihead_attn
  copying apex\contrib\test\multihead_attn\test_mha_fused_softmax.py -> build\lib\apex\contrib\test\multihead_attn
  copying apex\contrib\test\multihead_attn\test_self_multihead_attn.py -> build\lib\apex\contrib\test\multihead_attn
  copying apex\contrib\test\multihead_attn\test_self_multihead_attn_norm_add.py -> build\lib\apex\contrib\test\multihead_attn
  copying apex\contrib\test\multihead_attn\__init__.py -> build\lib\apex\contrib\test\multihead_attn
  creating build\lib\apex\contrib\test\optimizers
  copying apex\contrib\test\optimizers\test_distributed_fused_lamb.py -> build\lib\apex\contrib\test\optimizers
  copying apex\contrib\test\optimizers\test_dist_adam.py -> build\lib\apex\contrib\test\optimizers
  copying apex\contrib\test\optimizers\__init__.py -> build\lib\apex\contrib\test\optimizers
  creating build\lib\apex\contrib\test\peer_memory
  copying apex\contrib\test\peer_memory\test_peer_halo_exchange_module.py -> build\lib\apex\contrib\test\peer_memory
  copying apex\contrib\test\peer_memory\__init__.py -> build\lib\apex\contrib\test\peer_memory
  creating build\lib\apex\contrib\test\transducer
  copying apex\contrib\test\transducer\test_transducer_joint.py -> build\lib\apex\contrib\test\transducer
  copying apex\contrib\test\transducer\test_transducer_loss.py -> build\lib\apex\contrib\test\transducer
  copying apex\contrib\test\transducer\__init__.py -> build\lib\apex\contrib\test\transducer
  creating build\lib\apex\contrib\test\xentropy
  copying apex\contrib\test\xentropy\test_label_smoothing.py -> build\lib\apex\contrib\test\xentropy
  copying apex\contrib\test\xentropy\__init__.py -> build\lib\apex\contrib\test\xentropy
  creating build\lib\apex\transformer\amp
  copying apex\transformer\amp\grad_scaler.py -> build\lib\apex\transformer\amp
  copying apex\transformer\amp\__init__.py -> build\lib\apex\transformer\amp
  creating build\lib\apex\transformer\functional
  copying apex\transformer\functional\fused_rope.py -> build\lib\apex\transformer\functional
  copying apex\transformer\functional\fused_softmax.py -> build\lib\apex\transformer\functional
  copying apex\transformer\functional\__init__.py -> build\lib\apex\transformer\functional
  creating build\lib\apex\transformer\layers
  copying apex\transformer\layers\layer_norm.py -> build\lib\apex\transformer\layers
  copying apex\transformer\layers\__init__.py -> build\lib\apex\transformer\layers
  creating build\lib\apex\transformer\pipeline_parallel
  copying apex\transformer\pipeline_parallel\p2p_communication.py -> build\lib\apex\transformer\pipeline_parallel
  copying apex\transformer\pipeline_parallel\utils.py -> build\lib\apex\transformer\pipeline_parallel
  copying apex\transformer\pipeline_parallel\_timers.py -> build\lib\apex\transformer\pipeline_parallel
  copying apex\transformer\pipeline_parallel\__init__.py -> build\lib\apex\transformer\pipeline_parallel
  creating build\lib\apex\transformer\tensor_parallel
  copying apex\transformer\tensor_parallel\cross_entropy.py -> build\lib\apex\transformer\tensor_parallel
  copying apex\transformer\tensor_parallel\data.py -> build\lib\apex\transformer\tensor_parallel
  copying apex\transformer\tensor_parallel\layers.py -> build\lib\apex\transformer\tensor_parallel
  copying apex\transformer\tensor_parallel\mappings.py -> build\lib\apex\transformer\tensor_parallel
  copying apex\transformer\tensor_parallel\memory.py -> build\lib\apex\transformer\tensor_parallel
  copying apex\transformer\tensor_parallel\random.py -> build\lib\apex\transformer\tensor_parallel
  copying apex\transformer\tensor_parallel\utils.py -> build\lib\apex\transformer\tensor_parallel
  copying apex\transformer\tensor_parallel\__init__.py -> build\lib\apex\transformer\tensor_parallel
  creating build\lib\apex\transformer\testing
  copying apex\transformer\testing\arguments.py -> build\lib\apex\transformer\testing
  copying apex\transformer\testing\commons.py -> build\lib\apex\transformer\testing
  copying apex\transformer\testing\distributed_test_base.py -> build\lib\apex\transformer\testing
  copying apex\transformer\testing\global_vars.py -> build\lib\apex\transformer\testing
  copying apex\transformer\testing\standalone_bert.py -> build\lib\apex\transformer\testing
  copying apex\transformer\testing\standalone_gpt.py -> build\lib\apex\transformer\testing
  copying apex\transformer\testing\standalone_transformer_lm.py -> build\lib\apex\transformer\testing
  copying apex\transformer\testing\__init__.py -> build\lib\apex\transformer\testing
  creating build\lib\apex\transformer\_data
  copying apex\transformer\_data\_batchsampler.py -> build\lib\apex\transformer\_data
  copying apex\transformer\_data\__init__.py -> build\lib\apex\transformer\_data
  creating build\lib\apex\transformer\pipeline_parallel\schedules
  copying apex\transformer\pipeline_parallel\schedules\common.py -> build\lib\apex\transformer\pipeline_parallel\schedules
  copying apex\transformer\pipeline_parallel\schedules\fwd_bwd_no_pipelining.py -> build\lib\apex\transformer\pipeline_parallel\schedules
  copying apex\transformer\pipeline_parallel\schedules\fwd_bwd_pipelining_without_interleaving.py -> build\lib\apex\transformer\pipeline_parallel\schedules
  copying apex\transformer\pipeline_parallel\schedules\fwd_bwd_pipelining_with_interleaving.py -> build\lib\apex\transformer\pipeline_parallel\schedules
  copying apex\transformer\pipeline_parallel\schedules\__init__.py -> build\lib\apex\transformer\pipeline_parallel\schedules
  installing to build\bdist.win-amd64\wheel
  running install
  running install_lib
  creating build\bdist.win-amd64
  creating build\bdist.win-amd64\wheel
  creating build\bdist.win-amd64\wheel\apex
  creating build\bdist.win-amd64\wheel\apex\amp
  copying build\lib\apex\amp\amp.py -> build\bdist.win-amd64\wheel\.\apex\amp
  copying build\lib\apex\amp\compat.py -> build\bdist.win-amd64\wheel\.\apex\amp
  copying build\lib\apex\amp\frontend.py -> build\bdist.win-amd64\wheel\.\apex\amp
  copying build\lib\apex\amp\handle.py -> build\bdist.win-amd64\wheel\.\apex\amp
  creating build\bdist.win-amd64\wheel\apex\amp\lists
  copying build\lib\apex\amp\lists\functional_overrides.py -> build\bdist.win-amd64\wheel\.\apex\amp\lists
  copying build\lib\apex\amp\lists\tensor_overrides.py -> build\bdist.win-amd64\wheel\.\apex\amp\lists
  copying build\lib\apex\amp\lists\torch_overrides.py -> build\bdist.win-amd64\wheel\.\apex\amp\lists
  copying build\lib\apex\amp\lists\__init__.py -> build\bdist.win-amd64\wheel\.\apex\amp\lists
  copying build\lib\apex\amp\opt.py -> build\bdist.win-amd64\wheel\.\apex\amp
  copying build\lib\apex\amp\rnn_compat.py -> build\bdist.win-amd64\wheel\.\apex\amp
  copying build\lib\apex\amp\scaler.py -> build\bdist.win-amd64\wheel\.\apex\amp
  copying build\lib\apex\amp\utils.py -> build\bdist.win-amd64\wheel\.\apex\amp
  copying build\lib\apex\amp\wrap.py -> build\bdist.win-amd64\wheel\.\apex\amp
  copying build\lib\apex\amp\_amp_state.py -> build\bdist.win-amd64\wheel\.\apex\amp
  copying build\lib\apex\amp\_initialize.py -> build\bdist.win-amd64\wheel\.\apex\amp
  copying build\lib\apex\amp\_process_optimizer.py -> build\bdist.win-amd64\wheel\.\apex\amp
  copying build\lib\apex\amp\__init__.py -> build\bdist.win-amd64\wheel\.\apex\amp
  copying build\lib\apex\amp\__version__.py -> build\bdist.win-amd64\wheel\.\apex\amp
  creating build\bdist.win-amd64\wheel\apex\contrib
  creating build\bdist.win-amd64\wheel\apex\contrib\bottleneck
  copying build\lib\apex\contrib\bottleneck\bottleneck.py -> build\bdist.win-amd64\wheel\.\apex\contrib\bottleneck
  copying build\lib\apex\contrib\bottleneck\halo_exchangers.py -> build\bdist.win-amd64\wheel\.\apex\contrib\bottleneck
  copying build\lib\apex\contrib\bottleneck\test.py -> build\bdist.win-amd64\wheel\.\apex\contrib\bottleneck
  copying build\lib\apex\contrib\bottleneck\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\bottleneck
  creating build\bdist.win-amd64\wheel\apex\contrib\clip_grad
  copying build\lib\apex\contrib\clip_grad\clip_grad.py -> build\bdist.win-amd64\wheel\.\apex\contrib\clip_grad
  copying build\lib\apex\contrib\clip_grad\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\clip_grad
  creating build\bdist.win-amd64\wheel\apex\contrib\conv_bias_relu
  copying build\lib\apex\contrib\conv_bias_relu\conv_bias_relu.py -> build\bdist.win-amd64\wheel\.\apex\contrib\conv_bias_relu
  copying build\lib\apex\contrib\conv_bias_relu\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\conv_bias_relu
  creating build\bdist.win-amd64\wheel\apex\contrib\cudnn_gbn
  copying build\lib\apex\contrib\cudnn_gbn\batch_norm.py -> build\bdist.win-amd64\wheel\.\apex\contrib\cudnn_gbn
  copying build\lib\apex\contrib\cudnn_gbn\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\cudnn_gbn
  creating build\bdist.win-amd64\wheel\apex\contrib\fmha
  copying build\lib\apex\contrib\fmha\fmha.py -> build\bdist.win-amd64\wheel\.\apex\contrib\fmha
  copying build\lib\apex\contrib\fmha\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\fmha
  creating build\bdist.win-amd64\wheel\apex\contrib\focal_loss
  copying build\lib\apex\contrib\focal_loss\focal_loss.py -> build\bdist.win-amd64\wheel\.\apex\contrib\focal_loss
  copying build\lib\apex\contrib\focal_loss\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\focal_loss
  creating build\bdist.win-amd64\wheel\apex\contrib\gpu_direct_storage
  copying build\lib\apex\contrib\gpu_direct_storage\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\gpu_direct_storage
  creating build\bdist.win-amd64\wheel\apex\contrib\groupbn
  copying build\lib\apex\contrib\groupbn\batch_norm.py -> build\bdist.win-amd64\wheel\.\apex\contrib\groupbn
  copying build\lib\apex\contrib\groupbn\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\groupbn
  creating build\bdist.win-amd64\wheel\apex\contrib\group_norm
  copying build\lib\apex\contrib\group_norm\group_norm.py -> build\bdist.win-amd64\wheel\.\apex\contrib\group_norm
  copying build\lib\apex\contrib\group_norm\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\group_norm
  creating build\bdist.win-amd64\wheel\apex\contrib\index_mul_2d
  copying build\lib\apex\contrib\index_mul_2d\index_mul_2d.py -> build\bdist.win-amd64\wheel\.\apex\contrib\index_mul_2d
  copying build\lib\apex\contrib\index_mul_2d\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\index_mul_2d
  creating build\bdist.win-amd64\wheel\apex\contrib\layer_norm
  copying build\lib\apex\contrib\layer_norm\layer_norm.py -> build\bdist.win-amd64\wheel\.\apex\contrib\layer_norm
  copying build\lib\apex\contrib\layer_norm\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\layer_norm
  creating build\bdist.win-amd64\wheel\apex\contrib\multihead_attn
  copying build\lib\apex\contrib\multihead_attn\encdec_multihead_attn.py -> build\bdist.win-amd64\wheel\.\apex\contrib\multihead_attn
  copying build\lib\apex\contrib\multihead_attn\encdec_multihead_attn_func.py -> build\bdist.win-amd64\wheel\.\apex\contrib\multihead_attn
  copying build\lib\apex\contrib\multihead_attn\fast_encdec_multihead_attn_func.py -> build\bdist.win-amd64\wheel\.\apex\contrib\multihead_attn
  copying build\lib\apex\contrib\multihead_attn\fast_encdec_multihead_attn_norm_add_func.py -> build\bdist.win-amd64\wheel\.\apex\contrib\multihead_attn
  copying build\lib\apex\contrib\multihead_attn\fast_self_multihead_attn_func.py -> build\bdist.win-amd64\wheel\.\apex\contrib\multihead_attn
  copying build\lib\apex\contrib\multihead_attn\fast_self_multihead_attn_norm_add_func.py -> build\bdist.win-amd64\wheel\.\apex\contrib\multihead_attn
  copying build\lib\apex\contrib\multihead_attn\mask_softmax_dropout_func.py -> build\bdist.win-amd64\wheel\.\apex\contrib\multihead_attn
  copying build\lib\apex\contrib\multihead_attn\self_multihead_attn.py -> build\bdist.win-amd64\wheel\.\apex\contrib\multihead_attn
  copying build\lib\apex\contrib\multihead_attn\self_multihead_attn_func.py -> build\bdist.win-amd64\wheel\.\apex\contrib\multihead_attn
  copying build\lib\apex\contrib\multihead_attn\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\multihead_attn
  creating build\bdist.win-amd64\wheel\apex\contrib\nccl_allocator
  copying build\lib\apex\contrib\nccl_allocator\nccl_allocator.py -> build\bdist.win-amd64\wheel\.\apex\contrib\nccl_allocator
  copying build\lib\apex\contrib\nccl_allocator\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\nccl_allocator
  creating build\bdist.win-amd64\wheel\apex\contrib\openfold_triton
  copying build\lib\apex\contrib\openfold_triton\fused_adam_swa.py -> build\bdist.win-amd64\wheel\.\apex\contrib\openfold_triton
  copying build\lib\apex\contrib\openfold_triton\layer_norm.py -> build\bdist.win-amd64\wheel\.\apex\contrib\openfold_triton
  copying build\lib\apex\contrib\openfold_triton\mha.py -> build\bdist.win-amd64\wheel\.\apex\contrib\openfold_triton
  copying build\lib\apex\contrib\openfold_triton\_layer_norm_backward_kernels.py -> build\bdist.win-amd64\wheel\.\apex\contrib\openfold_triton
  copying build\lib\apex\contrib\openfold_triton\_layer_norm_config_ampere.py -> build\bdist.win-amd64\wheel\.\apex\contrib\openfold_triton
  copying build\lib\apex\contrib\openfold_triton\_layer_norm_config_hopper.py -> build\bdist.win-amd64\wheel\.\apex\contrib\openfold_triton
  copying build\lib\apex\contrib\openfold_triton\_layer_norm_forward_kernels.py -> build\bdist.win-amd64\wheel\.\apex\contrib\openfold_triton
  copying build\lib\apex\contrib\openfold_triton\_mha_kernel.py -> build\bdist.win-amd64\wheel\.\apex\contrib\openfold_triton
  copying build\lib\apex\contrib\openfold_triton\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\openfold_triton
  creating build\bdist.win-amd64\wheel\apex\contrib\optimizers
  copying build\lib\apex\contrib\optimizers\distributed_fused_adam.py -> build\bdist.win-amd64\wheel\.\apex\contrib\optimizers
  copying build\lib\apex\contrib\optimizers\distributed_fused_lamb.py -> build\bdist.win-amd64\wheel\.\apex\contrib\optimizers
  copying build\lib\apex\contrib\optimizers\fp16_optimizer.py -> build\bdist.win-amd64\wheel\.\apex\contrib\optimizers
  copying build\lib\apex\contrib\optimizers\fused_adam.py -> build\bdist.win-amd64\wheel\.\apex\contrib\optimizers
  copying build\lib\apex\contrib\optimizers\fused_lamb.py -> build\bdist.win-amd64\wheel\.\apex\contrib\optimizers
  copying build\lib\apex\contrib\optimizers\fused_sgd.py -> build\bdist.win-amd64\wheel\.\apex\contrib\optimizers
  copying build\lib\apex\contrib\optimizers\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\optimizers
  creating build\bdist.win-amd64\wheel\apex\contrib\peer_memory
  copying build\lib\apex\contrib\peer_memory\peer_halo_exchanger_1d.py -> build\bdist.win-amd64\wheel\.\apex\contrib\peer_memory
  copying build\lib\apex\contrib\peer_memory\peer_memory.py -> build\bdist.win-amd64\wheel\.\apex\contrib\peer_memory
  copying build\lib\apex\contrib\peer_memory\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\peer_memory
  creating build\bdist.win-amd64\wheel\apex\contrib\sparsity
  copying build\lib\apex\contrib\sparsity\asp.py -> build\bdist.win-amd64\wheel\.\apex\contrib\sparsity
  copying build\lib\apex\contrib\sparsity\permutation_lib.py -> build\bdist.win-amd64\wheel\.\apex\contrib\sparsity
  creating build\bdist.win-amd64\wheel\apex\contrib\sparsity\permutation_search_kernels
  copying build\lib\apex\contrib\sparsity\permutation_search_kernels\call_permutation_search_kernels.py -> build\bdist.win-amd64\wheel\.\apex\contrib\sparsity\permutation_search_kernels
  copying build\lib\apex\contrib\sparsity\permutation_search_kernels\channel_swap.py -> build\bdist.win-amd64\wheel\.\apex\contrib\sparsity\permutation_search_kernels
  copying build\lib\apex\contrib\sparsity\permutation_search_kernels\exhaustive_search.py -> build\bdist.win-amd64\wheel\.\apex\contrib\sparsity\permutation_search_kernels
  copying build\lib\apex\contrib\sparsity\permutation_search_kernels\permutation_utilities.py -> build\bdist.win-amd64\wheel\.\apex\contrib\sparsity\permutation_search_kernels
  copying build\lib\apex\contrib\sparsity\permutation_search_kernels\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\sparsity\permutation_search_kernels
  copying build\lib\apex\contrib\sparsity\sparse_masklib.py -> build\bdist.win-amd64\wheel\.\apex\contrib\sparsity
  copying build\lib\apex\contrib\sparsity\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\sparsity
  creating build\bdist.win-amd64\wheel\apex\contrib\test
  creating build\bdist.win-amd64\wheel\apex\contrib\test\bottleneck
  copying build\lib\apex\contrib\test\bottleneck\test_bottleneck_module.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\bottleneck
  copying build\lib\apex\contrib\test\bottleneck\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\bottleneck
  creating build\bdist.win-amd64\wheel\apex\contrib\test\clip_grad
  copying build\lib\apex\contrib\test\clip_grad\test_clip_grad.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\clip_grad
  copying build\lib\apex\contrib\test\clip_grad\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\clip_grad
  creating build\bdist.win-amd64\wheel\apex\contrib\test\conv_bias_relu
  copying build\lib\apex\contrib\test\conv_bias_relu\test_conv_bias_relu.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\conv_bias_relu
  copying build\lib\apex\contrib\test\conv_bias_relu\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\conv_bias_relu
  creating build\bdist.win-amd64\wheel\apex\contrib\test\cudnn_gbn
  copying build\lib\apex\contrib\test\cudnn_gbn\test_cudnn_gbn_with_two_gpus.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\cudnn_gbn
  copying build\lib\apex\contrib\test\cudnn_gbn\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\cudnn_gbn
  creating build\bdist.win-amd64\wheel\apex\contrib\test\fmha
  copying build\lib\apex\contrib\test\fmha\test_fmha.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\fmha
  copying build\lib\apex\contrib\test\fmha\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\fmha
  creating build\bdist.win-amd64\wheel\apex\contrib\test\focal_loss
  copying build\lib\apex\contrib\test\focal_loss\test_focal_loss.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\focal_loss
  copying build\lib\apex\contrib\test\focal_loss\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\focal_loss
  creating build\bdist.win-amd64\wheel\apex\contrib\test\group_norm
  copying build\lib\apex\contrib\test\group_norm\test_group_norm.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\group_norm
  copying build\lib\apex\contrib\test\group_norm\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\group_norm
  creating build\bdist.win-amd64\wheel\apex\contrib\test\index_mul_2d
  copying build\lib\apex\contrib\test\index_mul_2d\test_index_mul_2d.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\index_mul_2d
  copying build\lib\apex\contrib\test\index_mul_2d\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\index_mul_2d
  creating build\bdist.win-amd64\wheel\apex\contrib\test\layer_norm
  copying build\lib\apex\contrib\test\layer_norm\test_fast_layer_norm.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\layer_norm
  copying build\lib\apex\contrib\test\layer_norm\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\layer_norm
  creating build\bdist.win-amd64\wheel\apex\contrib\test\multihead_attn
  copying build\lib\apex\contrib\test\multihead_attn\test_encdec_multihead_attn.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\multihead_attn
  copying build\lib\apex\contrib\test\multihead_attn\test_encdec_multihead_attn_norm_add.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\multihead_attn
  copying build\lib\apex\contrib\test\multihead_attn\test_fast_self_multihead_attn_bias.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\multihead_attn
  copying build\lib\apex\contrib\test\multihead_attn\test_mha_fused_softmax.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\multihead_attn
  copying build\lib\apex\contrib\test\multihead_attn\test_self_multihead_attn.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\multihead_attn
  copying build\lib\apex\contrib\test\multihead_attn\test_self_multihead_attn_norm_add.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\multihead_attn
  copying build\lib\apex\contrib\test\multihead_attn\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\multihead_attn
  creating build\bdist.win-amd64\wheel\apex\contrib\test\optimizers
  copying build\lib\apex\contrib\test\optimizers\test_distributed_fused_lamb.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\optimizers
  copying build\lib\apex\contrib\test\optimizers\test_dist_adam.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\optimizers
  copying build\lib\apex\contrib\test\optimizers\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\optimizers
  creating build\bdist.win-amd64\wheel\apex\contrib\test\peer_memory
  copying build\lib\apex\contrib\test\peer_memory\test_peer_halo_exchange_module.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\peer_memory
  copying build\lib\apex\contrib\test\peer_memory\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\peer_memory
  creating build\bdist.win-amd64\wheel\apex\contrib\test\transducer
  copying build\lib\apex\contrib\test\transducer\test_transducer_joint.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\transducer
  copying build\lib\apex\contrib\test\transducer\test_transducer_loss.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\transducer
  copying build\lib\apex\contrib\test\transducer\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\transducer
  creating build\bdist.win-amd64\wheel\apex\contrib\test\xentropy
  copying build\lib\apex\contrib\test\xentropy\test_label_smoothing.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\xentropy
  copying build\lib\apex\contrib\test\xentropy\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test\xentropy
  copying build\lib\apex\contrib\test\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\test
  creating build\bdist.win-amd64\wheel\apex\contrib\transducer
  copying build\lib\apex\contrib\transducer\transducer.py -> build\bdist.win-amd64\wheel\.\apex\contrib\transducer
  copying build\lib\apex\contrib\transducer\_transducer_ref.py -> build\bdist.win-amd64\wheel\.\apex\contrib\transducer
  copying build\lib\apex\contrib\transducer\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\transducer
  creating build\bdist.win-amd64\wheel\apex\contrib\xentropy
  copying build\lib\apex\contrib\xentropy\softmax_xentropy.py -> build\bdist.win-amd64\wheel\.\apex\contrib\xentropy
  copying build\lib\apex\contrib\xentropy\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib\xentropy
  copying build\lib\apex\contrib\__init__.py -> build\bdist.win-amd64\wheel\.\apex\contrib
  creating build\bdist.win-amd64\wheel\apex\fp16_utils
  copying build\lib\apex\fp16_utils\fp16util.py -> build\bdist.win-amd64\wheel\.\apex\fp16_utils
  copying build\lib\apex\fp16_utils\fp16_optimizer.py -> build\bdist.win-amd64\wheel\.\apex\fp16_utils
  copying build\lib\apex\fp16_utils\loss_scaler.py -> build\bdist.win-amd64\wheel\.\apex\fp16_utils
  copying build\lib\apex\fp16_utils\__init__.py -> build\bdist.win-amd64\wheel\.\apex\fp16_utils
  creating build\bdist.win-amd64\wheel\apex\fused_dense
  copying build\lib\apex\fused_dense\fused_dense.py -> build\bdist.win-amd64\wheel\.\apex\fused_dense
  copying build\lib\apex\fused_dense\__init__.py -> build\bdist.win-amd64\wheel\.\apex\fused_dense
  creating build\bdist.win-amd64\wheel\apex\mlp
  copying build\lib\apex\mlp\mlp.py -> build\bdist.win-amd64\wheel\.\apex\mlp
  copying build\lib\apex\mlp\__init__.py -> build\bdist.win-amd64\wheel\.\apex\mlp
  creating build\bdist.win-amd64\wheel\apex\multi_tensor_apply
  copying build\lib\apex\multi_tensor_apply\multi_tensor_apply.py -> build\bdist.win-amd64\wheel\.\apex\multi_tensor_apply
  copying build\lib\apex\multi_tensor_apply\__init__.py -> build\bdist.win-amd64\wheel\.\apex\multi_tensor_apply
  creating build\bdist.win-amd64\wheel\apex\normalization
  copying build\lib\apex\normalization\fused_layer_norm.py -> build\bdist.win-amd64\wheel\.\apex\normalization
  copying build\lib\apex\normalization\__init__.py -> build\bdist.win-amd64\wheel\.\apex\normalization
  creating build\bdist.win-amd64\wheel\apex\optimizers
  copying build\lib\apex\optimizers\fused_adagrad.py -> build\bdist.win-amd64\wheel\.\apex\optimizers
  copying build\lib\apex\optimizers\fused_adam.py -> build\bdist.win-amd64\wheel\.\apex\optimizers
  copying build\lib\apex\optimizers\fused_lamb.py -> build\bdist.win-amd64\wheel\.\apex\optimizers
  copying build\lib\apex\optimizers\fused_mixed_precision_lamb.py -> build\bdist.win-amd64\wheel\.\apex\optimizers
  copying build\lib\apex\optimizers\fused_novograd.py -> build\bdist.win-amd64\wheel\.\apex\optimizers
  copying build\lib\apex\optimizers\fused_sgd.py -> build\bdist.win-amd64\wheel\.\apex\optimizers
  copying build\lib\apex\optimizers\__init__.py -> build\bdist.win-amd64\wheel\.\apex\optimizers
  creating build\bdist.win-amd64\wheel\apex\parallel
  copying build\lib\apex\parallel\distributed.py -> build\bdist.win-amd64\wheel\.\apex\parallel
  copying build\lib\apex\parallel\LARC.py -> build\bdist.win-amd64\wheel\.\apex\parallel
  copying build\lib\apex\parallel\multiproc.py -> build\bdist.win-amd64\wheel\.\apex\parallel
  copying build\lib\apex\parallel\optimized_sync_batchnorm.py -> build\bdist.win-amd64\wheel\.\apex\parallel
  copying build\lib\apex\parallel\optimized_sync_batchnorm_kernel.py -> build\bdist.win-amd64\wheel\.\apex\parallel
  copying build\lib\apex\parallel\sync_batchnorm.py -> build\bdist.win-amd64\wheel\.\apex\parallel
  copying build\lib\apex\parallel\sync_batchnorm_kernel.py -> build\bdist.win-amd64\wheel\.\apex\parallel
  copying build\lib\apex\parallel\__init__.py -> build\bdist.win-amd64\wheel\.\apex\parallel
  creating build\bdist.win-amd64\wheel\apex\RNN
  copying build\lib\apex\RNN\cells.py -> build\bdist.win-amd64\wheel\.\apex\RNN
  copying build\lib\apex\RNN\models.py -> build\bdist.win-amd64\wheel\.\apex\RNN
  copying build\lib\apex\RNN\RNNBackend.py -> build\bdist.win-amd64\wheel\.\apex\RNN
  copying build\lib\apex\RNN\__init__.py -> build\bdist.win-amd64\wheel\.\apex\RNN
  creating build\bdist.win-amd64\wheel\apex\transformer
  creating build\bdist.win-amd64\wheel\apex\transformer\amp
  copying build\lib\apex\transformer\amp\grad_scaler.py -> build\bdist.win-amd64\wheel\.\apex\transformer\amp
  copying build\lib\apex\transformer\amp\__init__.py -> build\bdist.win-amd64\wheel\.\apex\transformer\amp
  copying build\lib\apex\transformer\enums.py -> build\bdist.win-amd64\wheel\.\apex\transformer
  creating build\bdist.win-amd64\wheel\apex\transformer\functional
  copying build\lib\apex\transformer\functional\fused_rope.py -> build\bdist.win-amd64\wheel\.\apex\transformer\functional
  copying build\lib\apex\transformer\functional\fused_softmax.py -> build\bdist.win-amd64\wheel\.\apex\transformer\functional
  copying build\lib\apex\transformer\functional\__init__.py -> build\bdist.win-amd64\wheel\.\apex\transformer\functional
  creating build\bdist.win-amd64\wheel\apex\transformer\layers
  copying build\lib\apex\transformer\layers\layer_norm.py -> build\bdist.win-amd64\wheel\.\apex\transformer\layers
  copying build\lib\apex\transformer\layers\__init__.py -> build\bdist.win-amd64\wheel\.\apex\transformer\layers
  copying build\lib\apex\transformer\log_util.py -> build\bdist.win-amd64\wheel\.\apex\transformer
  copying build\lib\apex\transformer\microbatches.py -> build\bdist.win-amd64\wheel\.\apex\transformer
  copying build\lib\apex\transformer\parallel_state.py -> build\bdist.win-amd64\wheel\.\apex\transformer
  creating build\bdist.win-amd64\wheel\apex\transformer\pipeline_parallel
  copying build\lib\apex\transformer\pipeline_parallel\p2p_communication.py -> build\bdist.win-amd64\wheel\.\apex\transformer\pipeline_parallel
  creating build\bdist.win-amd64\wheel\apex\transformer\pipeline_parallel\schedules
  copying build\lib\apex\transformer\pipeline_parallel\schedules\common.py -> build\bdist.win-amd64\wheel\.\apex\transformer\pipeline_parallel\schedules
  copying build\lib\apex\transformer\pipeline_parallel\schedules\fwd_bwd_no_pipelining.py -> build\bdist.win-amd64\wheel\.\apex\transformer\pipeline_parallel\schedules
  copying build\lib\apex\transformer\pipeline_parallel\schedules\fwd_bwd_pipelining_without_interleaving.py -> build\bdist.win-amd64\wheel\.\apex\transformer\pipeline_parallel\schedules
  copying build\lib\apex\transformer\pipeline_parallel\schedules\fwd_bwd_pipelining_with_interleaving.py -> build\bdist.win-amd64\wheel\.\apex\transformer\pipeline_parallel\schedules
  copying build\lib\apex\transformer\pipeline_parallel\schedules\__init__.py -> build\bdist.win-amd64\wheel\.\apex\transformer\pipeline_parallel\schedules
  copying build\lib\apex\transformer\pipeline_parallel\utils.py -> build\bdist.win-amd64\wheel\.\apex\transformer\pipeline_parallel
  copying build\lib\apex\transformer\pipeline_parallel\_timers.py -> build\bdist.win-amd64\wheel\.\apex\transformer\pipeline_parallel
  copying build\lib\apex\transformer\pipeline_parallel\__init__.py -> build\bdist.win-amd64\wheel\.\apex\transformer\pipeline_parallel
  creating build\bdist.win-amd64\wheel\apex\transformer\tensor_parallel
  copying build\lib\apex\transformer\tensor_parallel\cross_entropy.py -> build\bdist.win-amd64\wheel\.\apex\transformer\tensor_parallel
  copying build\lib\apex\transformer\tensor_parallel\data.py -> build\bdist.win-amd64\wheel\.\apex\transformer\tensor_parallel
  copying build\lib\apex\transformer\tensor_parallel\layers.py -> build\bdist.win-amd64\wheel\.\apex\transformer\tensor_parallel
  copying build\lib\apex\transformer\tensor_parallel\mappings.py -> build\bdist.win-amd64\wheel\.\apex\transformer\tensor_parallel
  copying build\lib\apex\transformer\tensor_parallel\memory.py -> build\bdist.win-amd64\wheel\.\apex\transformer\tensor_parallel
  copying build\lib\apex\transformer\tensor_parallel\random.py -> build\bdist.win-amd64\wheel\.\apex\transformer\tensor_parallel
  copying build\lib\apex\transformer\tensor_parallel\utils.py -> build\bdist.win-amd64\wheel\.\apex\transformer\tensor_parallel
  copying build\lib\apex\transformer\tensor_parallel\__init__.py -> build\bdist.win-amd64\wheel\.\apex\transformer\tensor_parallel
  creating build\bdist.win-amd64\wheel\apex\transformer\testing
  copying build\lib\apex\transformer\testing\arguments.py -> build\bdist.win-amd64\wheel\.\apex\transformer\testing
  copying build\lib\apex\transformer\testing\commons.py -> build\bdist.win-amd64\wheel\.\apex\transformer\testing
  copying build\lib\apex\transformer\testing\distributed_test_base.py -> build\bdist.win-amd64\wheel\.\apex\transformer\testing
  copying build\lib\apex\transformer\testing\global_vars.py -> build\bdist.win-amd64\wheel\.\apex\transformer\testing
  copying build\lib\apex\transformer\testing\standalone_bert.py -> build\bdist.win-amd64\wheel\.\apex\transformer\testing
  copying build\lib\apex\transformer\testing\standalone_gpt.py -> build\bdist.win-amd64\wheel\.\apex\transformer\testing
  copying build\lib\apex\transformer\testing\standalone_transformer_lm.py -> build\bdist.win-amd64\wheel\.\apex\transformer\testing
  copying build\lib\apex\transformer\testing\__init__.py -> build\bdist.win-amd64\wheel\.\apex\transformer\testing
  copying build\lib\apex\transformer\utils.py -> build\bdist.win-amd64\wheel\.\apex\transformer
  creating build\bdist.win-amd64\wheel\apex\transformer\_data
  copying build\lib\apex\transformer\_data\_batchsampler.py -> build\bdist.win-amd64\wheel\.\apex\transformer\_data
  copying build\lib\apex\transformer\_data\__init__.py -> build\bdist.win-amd64\wheel\.\apex\transformer\_data
  copying build\lib\apex\transformer\_ucc_util.py -> build\bdist.win-amd64\wheel\.\apex\transformer
  copying build\lib\apex\transformer\__init__.py -> build\bdist.win-amd64\wheel\.\apex\transformer
  copying build\lib\apex\_autocast_utils.py -> build\bdist.win-amd64\wheel\.\apex
  copying build\lib\apex\__init__.py -> build\bdist.win-amd64\wheel\.\apex
  running install_egg_info
  running egg_info
  writing apex.egg-info\PKG-INFO
  writing dependency_links to apex.egg-info\dependency_links.txt
  writing requirements to apex.egg-info\requires.txt
  writing top-level names to apex.egg-info\top_level.txt
  reading manifest file 'apex.egg-info\SOURCES.txt'
  adding license file 'LICENSE'
  writing manifest file 'apex.egg-info\SOURCES.txt'
  Copying apex.egg-info to build\bdist.win-amd64\wheel\.\apex-0.1-py3.10.egg-info
  running install_scripts
  creating build\bdist.win-amd64\wheel\apex-0.1.dist-info\WHEEL
  creating 'C:\Users\himak\AppData\Local\Temp\pip-wheel-bw0py2sb\.tmp-g63gwrt1\apex-0.1-py3-none-any.whl' and adding 'build\bdist.win-amd64\wheel' to it
  adding 'apex/__init__.py'
  adding 'apex/_autocast_utils.py'
  adding 'apex/RNN/RNNBackend.py'
  adding 'apex/RNN/__init__.py'
  adding 'apex/RNN/cells.py'
  adding 'apex/RNN/models.py'
  adding 'apex/amp/__init__.py'
  adding 'apex/amp/__version__.py'
  adding 'apex/amp/_amp_state.py'
  adding 'apex/amp/_initialize.py'
  adding 'apex/amp/_process_optimizer.py'
  adding 'apex/amp/amp.py'
  adding 'apex/amp/compat.py'
  adding 'apex/amp/frontend.py'
  adding 'apex/amp/handle.py'
  adding 'apex/amp/opt.py'
  adding 'apex/amp/rnn_compat.py'
  adding 'apex/amp/scaler.py'
  adding 'apex/amp/utils.py'
  adding 'apex/amp/wrap.py'
  adding 'apex/amp/lists/__init__.py'
  adding 'apex/amp/lists/functional_overrides.py'
  adding 'apex/amp/lists/tensor_overrides.py'
  adding 'apex/amp/lists/torch_overrides.py'
  adding 'apex/contrib/__init__.py'
  adding 'apex/contrib/bottleneck/__init__.py'
  adding 'apex/contrib/bottleneck/bottleneck.py'
  adding 'apex/contrib/bottleneck/halo_exchangers.py'
  adding 'apex/contrib/bottleneck/test.py'
  adding 'apex/contrib/clip_grad/__init__.py'
  adding 'apex/contrib/clip_grad/clip_grad.py'
  adding 'apex/contrib/conv_bias_relu/__init__.py'
  adding 'apex/contrib/conv_bias_relu/conv_bias_relu.py'
  adding 'apex/contrib/cudnn_gbn/__init__.py'
  adding 'apex/contrib/cudnn_gbn/batch_norm.py'
  adding 'apex/contrib/fmha/__init__.py'
  adding 'apex/contrib/fmha/fmha.py'
  adding 'apex/contrib/focal_loss/__init__.py'
  adding 'apex/contrib/focal_loss/focal_loss.py'
  adding 'apex/contrib/gpu_direct_storage/__init__.py'
  adding 'apex/contrib/group_norm/__init__.py'
  adding 'apex/contrib/group_norm/group_norm.py'
  adding 'apex/contrib/groupbn/__init__.py'
  adding 'apex/contrib/groupbn/batch_norm.py'
  adding 'apex/contrib/index_mul_2d/__init__.py'
  adding 'apex/contrib/index_mul_2d/index_mul_2d.py'
  adding 'apex/contrib/layer_norm/__init__.py'
  adding 'apex/contrib/layer_norm/layer_norm.py'
  adding 'apex/contrib/multihead_attn/__init__.py'
  adding 'apex/contrib/multihead_attn/encdec_multihead_attn.py'
  adding 'apex/contrib/multihead_attn/encdec_multihead_attn_func.py'
  adding 'apex/contrib/multihead_attn/fast_encdec_multihead_attn_func.py'
  adding 'apex/contrib/multihead_attn/fast_encdec_multihead_attn_norm_add_func.py'
  adding 'apex/contrib/multihead_attn/fast_self_multihead_attn_func.py'
  adding 'apex/contrib/multihead_attn/fast_self_multihead_attn_norm_add_func.py'
  adding 'apex/contrib/multihead_attn/mask_softmax_dropout_func.py'
  adding 'apex/contrib/multihead_attn/self_multihead_attn.py'
  adding 'apex/contrib/multihead_attn/self_multihead_attn_func.py'
  adding 'apex/contrib/nccl_allocator/__init__.py'
  adding 'apex/contrib/nccl_allocator/nccl_allocator.py'
  adding 'apex/contrib/openfold_triton/__init__.py'
  adding 'apex/contrib/openfold_triton/_layer_norm_backward_kernels.py'
  adding 'apex/contrib/openfold_triton/_layer_norm_config_ampere.py'
  adding 'apex/contrib/openfold_triton/_layer_norm_config_hopper.py'
  adding 'apex/contrib/openfold_triton/_layer_norm_forward_kernels.py'
  adding 'apex/contrib/openfold_triton/_mha_kernel.py'
  adding 'apex/contrib/openfold_triton/fused_adam_swa.py'
  adding 'apex/contrib/openfold_triton/layer_norm.py'
  adding 'apex/contrib/openfold_triton/mha.py'
  adding 'apex/contrib/optimizers/__init__.py'
  adding 'apex/contrib/optimizers/distributed_fused_adam.py'
  adding 'apex/contrib/optimizers/distributed_fused_lamb.py'
  adding 'apex/contrib/optimizers/fp16_optimizer.py'
  adding 'apex/contrib/optimizers/fused_adam.py'
  adding 'apex/contrib/optimizers/fused_lamb.py'
  adding 'apex/contrib/optimizers/fused_sgd.py'
  adding 'apex/contrib/peer_memory/__init__.py'
  adding 'apex/contrib/peer_memory/peer_halo_exchanger_1d.py'
  adding 'apex/contrib/peer_memory/peer_memory.py'
  adding 'apex/contrib/sparsity/__init__.py'
  adding 'apex/contrib/sparsity/asp.py'
  adding 'apex/contrib/sparsity/permutation_lib.py'
  adding 'apex/contrib/sparsity/sparse_masklib.py'
  adding 'apex/contrib/sparsity/permutation_search_kernels/__init__.py'
  adding 'apex/contrib/sparsity/permutation_search_kernels/call_permutation_search_kernels.py'
  adding 'apex/contrib/sparsity/permutation_search_kernels/channel_swap.py'
  adding 'apex/contrib/sparsity/permutation_search_kernels/exhaustive_search.py'
  adding 'apex/contrib/sparsity/permutation_search_kernels/permutation_utilities.py'
  adding 'apex/contrib/test/__init__.py'
  adding 'apex/contrib/test/bottleneck/__init__.py'
  adding 'apex/contrib/test/bottleneck/test_bottleneck_module.py'
  adding 'apex/contrib/test/clip_grad/__init__.py'
  adding 'apex/contrib/test/clip_grad/test_clip_grad.py'
  adding 'apex/contrib/test/conv_bias_relu/__init__.py'
  adding 'apex/contrib/test/conv_bias_relu/test_conv_bias_relu.py'
  adding 'apex/contrib/test/cudnn_gbn/__init__.py'
  adding 'apex/contrib/test/cudnn_gbn/test_cudnn_gbn_with_two_gpus.py'
  adding 'apex/contrib/test/fmha/__init__.py'
  adding 'apex/contrib/test/fmha/test_fmha.py'
  adding 'apex/contrib/test/focal_loss/__init__.py'
  adding 'apex/contrib/test/focal_loss/test_focal_loss.py'
  adding 'apex/contrib/test/group_norm/__init__.py'
  adding 'apex/contrib/test/group_norm/test_group_norm.py'
  adding 'apex/contrib/test/index_mul_2d/__init__.py'
  adding 'apex/contrib/test/index_mul_2d/test_index_mul_2d.py'
  adding 'apex/contrib/test/layer_norm/__init__.py'
  adding 'apex/contrib/test/layer_norm/test_fast_layer_norm.py'
  adding 'apex/contrib/test/multihead_attn/__init__.py'
  adding 'apex/contrib/test/multihead_attn/test_encdec_multihead_attn.py'
  adding 'apex/contrib/test/multihead_attn/test_encdec_multihead_attn_norm_add.py'
  adding 'apex/contrib/test/multihead_attn/test_fast_self_multihead_attn_bias.py'
  adding 'apex/contrib/test/multihead_attn/test_mha_fused_softmax.py'
  adding 'apex/contrib/test/multihead_attn/test_self_multihead_attn.py'
  adding 'apex/contrib/test/multihead_attn/test_self_multihead_attn_norm_add.py'
  adding 'apex/contrib/test/optimizers/__init__.py'
  adding 'apex/contrib/test/optimizers/test_dist_adam.py'
  adding 'apex/contrib/test/optimizers/test_distributed_fused_lamb.py'
  adding 'apex/contrib/test/peer_memory/__init__.py'
  adding 'apex/contrib/test/peer_memory/test_peer_halo_exchange_module.py'
  adding 'apex/contrib/test/transducer/__init__.py'
  adding 'apex/contrib/test/transducer/test_transducer_joint.py'
  adding 'apex/contrib/test/transducer/test_transducer_loss.py'
  adding 'apex/contrib/test/xentropy/__init__.py'
  adding 'apex/contrib/test/xentropy/test_label_smoothing.py'
  adding 'apex/contrib/transducer/__init__.py'
  adding 'apex/contrib/transducer/_transducer_ref.py'
  adding 'apex/contrib/transducer/transducer.py'
  adding 'apex/contrib/xentropy/__init__.py'
  adding 'apex/contrib/xentropy/softmax_xentropy.py'
  adding 'apex/fp16_utils/__init__.py'
  adding 'apex/fp16_utils/fp16_optimizer.py'
  adding 'apex/fp16_utils/fp16util.py'
  adding 'apex/fp16_utils/loss_scaler.py'
  adding 'apex/fused_dense/__init__.py'
  adding 'apex/fused_dense/fused_dense.py'
  adding 'apex/mlp/__init__.py'
  adding 'apex/mlp/mlp.py'
  adding 'apex/multi_tensor_apply/__init__.py'
  adding 'apex/multi_tensor_apply/multi_tensor_apply.py'
  adding 'apex/normalization/__init__.py'
  adding 'apex/normalization/fused_layer_norm.py'
  adding 'apex/optimizers/__init__.py'
  adding 'apex/optimizers/fused_adagrad.py'
  adding 'apex/optimizers/fused_adam.py'
  adding 'apex/optimizers/fused_lamb.py'
  adding 'apex/optimizers/fused_mixed_precision_lamb.py'
  adding 'apex/optimizers/fused_novograd.py'
  adding 'apex/optimizers/fused_sgd.py'
  adding 'apex/parallel/LARC.py'
  adding 'apex/parallel/__init__.py'
  adding 'apex/parallel/distributed.py'
  adding 'apex/parallel/multiproc.py'
  adding 'apex/parallel/optimized_sync_batchnorm.py'
  adding 'apex/parallel/optimized_sync_batchnorm_kernel.py'
  adding 'apex/parallel/sync_batchnorm.py'
  adding 'apex/parallel/sync_batchnorm_kernel.py'
  adding 'apex/transformer/__init__.py'
  adding 'apex/transformer/_ucc_util.py'
  adding 'apex/transformer/enums.py'
  adding 'apex/transformer/log_util.py'
  adding 'apex/transformer/microbatches.py'
  adding 'apex/transformer/parallel_state.py'
  adding 'apex/transformer/utils.py'
  adding 'apex/transformer/_data/__init__.py'
  adding 'apex/transformer/_data/_batchsampler.py'
  adding 'apex/transformer/amp/__init__.py'
  adding 'apex/transformer/amp/grad_scaler.py'
  adding 'apex/transformer/functional/__init__.py'
  adding 'apex/transformer/functional/fused_rope.py'
  adding 'apex/transformer/functional/fused_softmax.py'
  adding 'apex/transformer/layers/__init__.py'
  adding 'apex/transformer/layers/layer_norm.py'
  adding 'apex/transformer/pipeline_parallel/__init__.py'
  adding 'apex/transformer/pipeline_parallel/_timers.py'
  adding 'apex/transformer/pipeline_parallel/p2p_communication.py'
  adding 'apex/transformer/pipeline_parallel/utils.py'
  adding 'apex/transformer/pipeline_parallel/schedules/__init__.py'
  adding 'apex/transformer/pipeline_parallel/schedules/common.py'
  adding 'apex/transformer/pipeline_parallel/schedules/fwd_bwd_no_pipelining.py'
  adding 'apex/transformer/pipeline_parallel/schedules/fwd_bwd_pipelining_with_interleaving.py'
  adding 'apex/transformer/pipeline_parallel/schedules/fwd_bwd_pipelining_without_interleaving.py'
  adding 'apex/transformer/tensor_parallel/__init__.py'
  adding 'apex/transformer/tensor_parallel/cross_entropy.py'
  adding 'apex/transformer/tensor_parallel/data.py'
  adding 'apex/transformer/tensor_parallel/layers.py'
  adding 'apex/transformer/tensor_parallel/mappings.py'
  adding 'apex/transformer/tensor_parallel/memory.py'
  adding 'apex/transformer/tensor_parallel/random.py'
  adding 'apex/transformer/tensor_parallel/utils.py'
  adding 'apex/transformer/testing/__init__.py'
  adding 'apex/transformer/testing/arguments.py'
  adding 'apex/transformer/testing/commons.py'
  adding 'apex/transformer/testing/distributed_test_base.py'
  adding 'apex/transformer/testing/global_vars.py'
  adding 'apex/transformer/testing/standalone_bert.py'
  adding 'apex/transformer/testing/standalone_gpt.py'
  adding 'apex/transformer/testing/standalone_transformer_lm.py'
  adding 'apex-0.1.dist-info/LICENSE'
  adding 'apex-0.1.dist-info/METADATA'
  adding 'apex-0.1.dist-info/WHEEL'
  adding 'apex-0.1.dist-info/top_level.txt'
  adding 'apex-0.1.dist-info/RECORD'
  removing build\bdist.win-amd64\wheel
  Building wheel for apex (pyproject.toml) ... done
  Created wheel for apex: filename=apex-0.1-py3-none-any.whl size=403133 sha256=90cada8be960658b2b1801e4288c1321958285cfdbfa328a13481260ab8ab814
  Stored in directory: C:\Users\himak\AppData\Local\Temp\pip-ephem-wheel-cache-w2ylhisv\wheels\64\53\e2\56393b3bff741ffbc156aac2353e7049ac748a7a5d554fbf94
Successfully built apex
Installing collected packages: apex
Successfully installed apex-0.1