EDEN ALPHA-26 Lab
🔱
Generate photorealistic images via a simple API
TJ SPENCER JACQUES PRO
AIBRUH
·
AI & ML interests
None yet
Recent Activity
updated
a Space about 19 hours ago
AIBRUH/eden-diffusion-studio updated
a model 2 days ago
AIBRUH/WRAP-EDEN published
a model 2 days ago
AIBRUH/WRAP-EDEN Organizations
updated a Space about 19 hours ago
updated a model 2 days ago
published a model 2 days ago
published a Space 4 days ago
updated a Space 4 days ago
published a Space 4 days ago
updated a Space 29 days ago
published a Space 30 days ago
updated a Space 30 days ago
published a Space about 1 month ago
updated a Space about 1 month ago
published a Space about 1 month ago
updated a Space about 1 month ago
published a Space about 1 month ago
updated a Space 3 months ago
published a Space 3 months ago
Request: Access Request for sesame/csm-1b
2
#21 opened 11 months ago
by
Sadegh69
updated a Space 3 months ago
published a Space 3 months ago
reacted to Locutusque's post with 🔥 3 months ago
Post
2767
🚀 AutoXLA - Accelerating Large Models on TPU
AutoXLA is an experimental library that automates the distribution, optimization, and quantization of large language models for TPUs using PyTorch/XLA. It extends the Hugging Face Transformers interface with TPU-aware features such as automatic sharding, custom attention kernels, and quantization-aware loading, making large-scale deployment and training both simpler and faster.
With quantization and Splash Attention kernels, AutoXLA achieves up to 4× speedups over standard Flash Attention implementations, significantly improving throughput for both inference and training workloads.
Whether you’re experimenting with distributed setups (FSDP, 2D, or 3D sharding) or optimizing memory via LanguageModelQuantizer, AutoXLA is built to make scaling LLMs on TPU seamless.
⚠️ Note: This is an experimental repository. Expect rough edges! Please report bugs or unexpected behavior through GitHub issues.
🔗 GitHub Repository: https://github.com/Locutusque/AutoXLA
AutoXLA is an experimental library that automates the distribution, optimization, and quantization of large language models for TPUs using PyTorch/XLA. It extends the Hugging Face Transformers interface with TPU-aware features such as automatic sharding, custom attention kernels, and quantization-aware loading, making large-scale deployment and training both simpler and faster.
With quantization and Splash Attention kernels, AutoXLA achieves up to 4× speedups over standard Flash Attention implementations, significantly improving throughput for both inference and training workloads.
Whether you’re experimenting with distributed setups (FSDP, 2D, or 3D sharding) or optimizing memory via LanguageModelQuantizer, AutoXLA is built to make scaling LLMs on TPU seamless.
⚠️ Note: This is an experimental repository. Expect rough edges! Please report bugs or unexpected behavior through GitHub issues.
🔗 GitHub Repository: https://github.com/Locutusque/AutoXLA