Recently, a significant pull request was merged into HuggingFace’s transformers repository — they removed about 50,000 lines of code in one go. How did it happen? It’s quite simple: the developers decided they will no longer support integration with JAX and TensorFlow. Currently, the library supports only PyTorch.
They justify this by wanting to make the project simpler and to eliminate unnecessary complexity, avoiding bloating the functionality without real need. As a result, support for JAX disappears, and although TensorFlow is not cut as sharply, it is also being reduced.
Honestly, it’s very unfortunate to lose support for JAX (the situation with TensorFlow is a bit easier, but still not very pleasing).