Good Libraries for Python, Rust, Swift, and More

Python

Daily drivers

• PyTorch [GitHub][pip install torch][Docs] Tensor go brrr

• openai [GitHub][PyPi]][Docs] OpenAI Python library for accessing various OpenAI models and tools.

• transformers [GitHub][PyPi][Docs] State-of-the-art natural language processing library for PyTorch and TensorFlow.

• asyncio [Docs] Concurrency using async/await. It's in the standard python lib, but you should use it more.

• aiohttp [GitHub][PyPi][Docs] Async HTTP client/server framework for use with asyncio.

• langchain [GitHub][PyPi][Docs] A Python library for language chain analysis and processing.

Rust-backed Python libraries to try

• ruff [GitHub][PyPi][Docs] Keep your code clean smh
• pola.rs [GitHub][Website][PyPi] Rust-backed DataFrame library for Python. High performance, multi-threaded query engine written in Rust and designed for effective paralellism. Vectorized and columnar processing enable cache-coherent algorithms and high performance on modern processors. Pandas on another level.
• tokenizers [GitHub][PyPi] - Rust-backed python library for efficient tokenization for natural language processing.

Make your own Rust-backed libraries

• Pyo3 Maturin [GitHub][PyPi] - Build and publish crates with pyo3, rust-cpython and cffi bindings as well as rust binaries as python packages.