Remove Unused Functions in apex\apex\transformer\tensor_parallel\random.py

[syedshazli]

In random.py, there are several functions which have a TODO to remove the functions due to being unused by megatron-lm. However, these functions still have not been removed.

In this PR, I removed the unused functions named 'init_checkpointed_activations_memory_buffer' and 'reset_checkpointed_activations_memory_buffer', as well as the global variable '_CHECKPOINTED_ACTIVATIONS_MEMORY_BUFFER'

[syedshazli]

cc @crcrpar

[syedshazli]

gentle ping @crcrpar

[crcrpar]

I think it'd be better to remove apex.transformer rather, following the existing deprecation warning --

apex/apex/transformer/parallel_state.py

Lines 213 to 218 in db8e053

	deprecated_warning(
	"`apex.transformer` is deprecated and will be removed in September 2025. "
	"We encourage you to migrate to Megatron Core. "
	"It is available on PyPI at https://pypi.org/project/megatron-core/ "
	"and its documentation can be found at https://docs.nvidia.com/megatron-core/developer-guide/latest/index.html."
	)

[syedshazli]

Ah okay that makes sense! I'll make some commits on my branch to just remove apex transformer

[crcrpar]

remember to remove the relevant tests as well

[syedshazli]

@crcrpar I just made the changes needed to deprecate transformer.

I removed the whole transformer folder, as well as one reference to the transformer module in the apex/apex directory. I made sure any tests referencing transformer were deleted, and also modified the test harness to not search for the transformer directory to run tests from.

Feel free to check and provide your thoughts! The branch is upstream with main as well

[Copilot]

Pull request overview

This pull request removes unused functions and test files from the apex.transformer module. The main changes involve:

• Removing two unused functions (init_checkpointed_activations_memory_buffer and reset_checkpointed_activations_memory_buffer) and a global variable (_CHECKPOINTED_ACTIVATIONS_MEMORY_BUFFER) from random.py
• Completely removing the entire apex.transformer module including all test files and supporting code
• Removing the transformer test directory from the test runner configuration

Reviewed changes

Copilot reviewed 66 out of 71 changed files in this pull request and generated no comments.

Show a summary per file

File	Description
apex/transformer/tensor_parallel/random.py	Deleted entire file containing the unused functions mentioned in PR description
apex/transformer/tensor_parallel/init.py	Deleted file that exported the removed functions
apex/transformer/tensor_parallel/*	Deleted all other tensor parallel implementation files
apex/transformer/testing/*	Deleted all testing utilities and test infrastructure
apex/transformer/utils.py	Deleted utility functions file
tests/L0/run_transformer/*	Deleted all transformer-related test files
tests/L1/transformer/*	Deleted L1 transformer test file
tests/L0/run_test.py	Removed "run_transformer" from default test directories

Note: The scope of this PR appears to be much larger than described. The PR description mentions removing only 2 functions and 1 global variable from random.py, but the actual changes delete the entire apex.transformer module and all associated tests. This is a breaking change that removes significant functionality from the codebase.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.