|
|
<!doctype html> |
|
|
<html lang="en"> |
|
|
<head> |
|
|
<meta charset="utf-8" /> |
|
|
<meta name="viewport" content="width=device-width, initial-scale=1" /> |
|
|
<title>RapidFire AI — LLM Fine-Tuning Workbench</title> |
|
|
<link rel="preconnect" href="https://fonts.googleapis.com"> |
|
|
<link rel="preconnect" href="https://fonts.gstatic.com" crossorigin> |
|
|
<link href="https://fonts.googleapis.com/css2?family=IBM+Plex+Sans:wght@400;500;600;700&display=swap" rel="stylesheet"> |
|
|
<style> |
|
|
body { |
|
|
font-family: 'IBM Plex Sans', -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, 'Helvetica Neue', Arial, sans-serif; |
|
|
line-height: 1.7; |
|
|
color: #ffffff; |
|
|
background: linear-gradient(135deg, #667eea 0%, #764ba2 25%, #f093fb 50%, #f5576c 100%); |
|
|
min-height: 100vh; |
|
|
margin: 0; |
|
|
padding: 2rem 1rem; |
|
|
transition: background 0.3s, color 0.3s; |
|
|
font-size: 18px; |
|
|
letter-spacing: 0.01em; |
|
|
} |
|
|
main { |
|
|
max-width: 1000px; |
|
|
margin: 0 auto; |
|
|
padding: 2rem; |
|
|
} |
|
|
h1 { |
|
|
font-size: 2.5rem; |
|
|
margin-bottom: 1.5rem; |
|
|
color: #ffffff; |
|
|
font-weight: 700; |
|
|
letter-spacing: -0.02em; |
|
|
} |
|
|
h3 { |
|
|
font-size: 1.75rem; |
|
|
font-weight: 700; |
|
|
margin-top: 2rem; |
|
|
margin-bottom: 1rem; |
|
|
color: #ffffff; |
|
|
letter-spacing: -0.01em; |
|
|
} |
|
|
p { |
|
|
margin-bottom: 1.25rem; |
|
|
font-size: 1.1rem; |
|
|
} |
|
|
a { |
|
|
color: #a0d8ff; |
|
|
text-decoration: none; |
|
|
} |
|
|
a:hover { |
|
|
text-decoration: underline; |
|
|
color: #ffffff; |
|
|
} |
|
|
ul { |
|
|
list-style: disc; |
|
|
padding-left: 2rem; |
|
|
} |
|
|
ul li { |
|
|
margin-bottom: 0.75rem; |
|
|
font-size: 1.05rem; |
|
|
} |
|
|
strong { |
|
|
font-weight: 600; |
|
|
} |
|
|
.logo { |
|
|
display: block; |
|
|
max-width: 400px; |
|
|
height: auto; |
|
|
margin: 0 auto 3rem auto; |
|
|
} |
|
|
.github-button { |
|
|
display: inline-flex; |
|
|
align-items: center; |
|
|
padding: 0.35rem 0.7rem; |
|
|
background-color: rgba(255, 255, 255, 0.2); |
|
|
color: #ffffff; |
|
|
text-decoration: none; |
|
|
border-radius: 4px; |
|
|
border: 1px solid rgba(255, 255, 255, 0.3); |
|
|
font-weight: 500; |
|
|
font-size: 1rem; |
|
|
transition: background-color 0.2s, border-color 0.2s; |
|
|
} |
|
|
.github-button:hover { |
|
|
background-color: rgba(255, 255, 255, 0.3); |
|
|
border-color: rgba(255, 255, 255, 0.5); |
|
|
text-decoration: none; |
|
|
color: #ffffff; |
|
|
} |
|
|
.github-button svg { |
|
|
margin-right: 0.4rem; |
|
|
width: 18px; |
|
|
height: 18px; |
|
|
} |
|
|
.github-button .repo-name { |
|
|
background-color: #0969da; |
|
|
color: #ffffff; |
|
|
padding: 0.2rem 0.5rem; |
|
|
border-radius: 3px; |
|
|
margin-left: 0.4rem; |
|
|
font-size: 0.95rem; |
|
|
} |
|
|
.colab-section { |
|
|
margin: 2rem 0; |
|
|
} |
|
|
.colab-label { |
|
|
font-size: 1.2rem; |
|
|
font-weight: 600; |
|
|
margin-bottom: 0.75rem; |
|
|
display: block; |
|
|
} |
|
|
.colab-button { |
|
|
display: inline-block; |
|
|
text-decoration: none; |
|
|
transition: opacity 0.2s; |
|
|
} |
|
|
.colab-button:hover { |
|
|
opacity: 0.8; |
|
|
text-decoration: none; |
|
|
} |
|
|
.colab-button img { |
|
|
height: 48px; |
|
|
display: block; |
|
|
} |
|
|
.notebooks-table { |
|
|
width: 100%; |
|
|
border-collapse: collapse; |
|
|
margin: 2rem 0; |
|
|
background-color: rgba(0, 0, 0, 0.2); |
|
|
border-radius: 8px; |
|
|
overflow: hidden; |
|
|
} |
|
|
.notebooks-table th { |
|
|
background-color: rgba(0, 0, 0, 0.3); |
|
|
color: #ffffff; |
|
|
padding: 1.25rem; |
|
|
text-align: left; |
|
|
font-weight: 600; |
|
|
font-size: 1.15rem; |
|
|
border-bottom: 2px solid rgba(255, 255, 255, 0.1); |
|
|
} |
|
|
.notebooks-table td { |
|
|
padding: 1.25rem; |
|
|
border-bottom: 1px solid rgba(255, 255, 255, 0.1); |
|
|
font-size: 1.05rem; |
|
|
} |
|
|
.notebooks-table tr:last-child td { |
|
|
border-bottom: none; |
|
|
} |
|
|
.notebooks-table tr:hover { |
|
|
background-color: rgba(255, 255, 255, 0.05); |
|
|
} |
|
|
.notebooks-table .colab-button img { |
|
|
height: 38px; |
|
|
} |
|
|
|
|
|
@media (prefers-color-scheme: dark) { |
|
|
body { |
|
|
background: linear-gradient(135deg, #1a1a2e 0%, #16213e 25%, #0f3460 50%, #533483 100%); |
|
|
color: #e8e8e8; |
|
|
} |
|
|
h1, h3 { |
|
|
color: #ffffff; |
|
|
} |
|
|
a { |
|
|
color: #a0d8ff; |
|
|
} |
|
|
a:hover { |
|
|
color: #ffffff; |
|
|
} |
|
|
.github-button { |
|
|
background-color: rgba(255, 255, 255, 0.15); |
|
|
color: #ffffff; |
|
|
border-color: rgba(255, 255, 255, 0.25); |
|
|
} |
|
|
.github-button:hover { |
|
|
background-color: rgba(255, 255, 255, 0.25); |
|
|
border-color: rgba(255, 255, 255, 0.4); |
|
|
} |
|
|
.github-button .repo-name { |
|
|
background-color: #1f6feb; |
|
|
} |
|
|
} |
|
|
</style> |
|
|
</head> |
|
|
<body> |
|
|
<main> |
|
|
<picture> |
|
|
<source srcset="images/RapidFire-logo-for-dark-theme.svg" media="(prefers-color-scheme: dark)"> |
|
|
<img src="images/RapidFire-logo-for-light-theme.svg" alt="RapidFire AI Logo" class="logo"> |
|
|
</picture> |
|
|
|
|
|
<p>RapidFire AI is an open-source Python engine to accelerate LLM fine-tuning and post-training with hyperparallel exeuction on the same resources and powerful interactive control to: stop, resume, clone-modify and warm-start configs on the fly. Branch experiments while they're running instead of starting from scratch or running one after another.</p> |
|
|
|
|
|
<ul> |
|
|
<li><strong>Works within your OSS stack:</strong> PyTorch, HuggingFace TRL/PEFT), MLflow.</li> |
|
|
<li><strong>Hyperparallel search:</strong> launch as many configs as you want together, even on a single GPU</li> |
|
|
<li><strong>Dynamic real-time control:</strong> stop laggards, resume them later to revisit, branch promising configs in flight.</li> |
|
|
<li><strong>Deterministic eval + run tracking:</strong> Metrics curves are automatically plotted and are comparable.</li> |
|
|
<li><strong>Apache License v2.0:</strong> No vendor lock in. Develop on your IDE, launch from CLI.</li> |
|
|
</ul> |
|
|
|
|
|
<div class="colab-section"> |
|
|
<h3>📓 Try it now:</h3> |
|
|
<p style="margin-bottom: 1.5rem;"> |
|
|
Try RapidFire AI in the Google Colab Notebook with no local installation—get started in under 3 minutes! |
|
|
</p> |
|
|
|
|
|
<table class="notebooks-table"> |
|
|
<thead> |
|
|
<tr> |
|
|
<th>Notebook</th> |
|
|
<th>Description</th> |
|
|
<th>Notebook Link</th> |
|
|
</tr> |
|
|
</thead> |
|
|
<tbody> |
|
|
<tr> |
|
|
<td><strong>rf-colab-tensorboard-tutorial.ipynb</strong></td> |
|
|
<td>Interactive tutorial with TensorBoard integration</td> |
|
|
<td> |
|
|
<a href="http://tinyurl.com/rapidfireai-colab" class="colab-button" target="_blank" rel="noopener noreferrer"> |
|
|
<img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab" /> |
|
|
</a> |
|
|
</td> |
|
|
</tr> |
|
|
</tbody> |
|
|
</table> |
|
|
</div> |
|
|
|
|
|
<h3>Links:</h3> |
|
|
<ul> |
|
|
<li> |
|
|
<a href="https://github.com/RapidFireAI/rapidfireai/" class="github-button" target="_blank" rel="noopener noreferrer"> |
|
|
<svg width="16" height="16" viewBox="0 0 16 16" fill="currentColor" aria-hidden="true"> |
|
|
<path d="M8 0C3.58 0 0 3.58 0 8c0 3.54 2.29 6.53 5.47 7.59.4.07.55-.17.55-.38 0-.19-.01-.82-.01-1.49-2.01.37-2.53-.49-2.69-.94-.09-.23-.48-.94-.82-1.13-.28-.15-.68-.52-.01-.53.63-.01 1.08.58 1.23.82.72 1.21 1.87.87 2.33.66.07-.52.28-.87.51-1.07-1.78-.2-3.64-.89-3.64-3.95 0-.87.31-1.59.82-2.15-.08-.2-.36-1.02.08-2.12 0 0 .67-.21 2.2.82.64-.18 1.32-.27 2-.27.68 0 1.36.09 2 .27 1.53-1.04 2.2-.82 2.2-.82.44 1.1.16 1.92.08 2.12.51.56.82 1.27.82 2.15 0 3.07-1.87 3.75-3.65 3.95.29.25.54.73.54 1.48 0 1.07-.01 1.93-.01 2.2 0 .21.15.46.55.38A8.013 8.013 0 0016 8c0-4.42-3.58-8-8-8z"></path> |
|
|
</svg> |
|
|
GitHub <span class="repo-name">rapidfireai</span> |
|
|
</a> |
|
|
</li> |
|
|
<li>🐍 PyPI: <a href="https://pypi.org/project/rapidfireai/" target="_blank" rel="noopener noreferrer">https://pypi.org/project/rapidfireai/</a></li> |
|
|
<li>📚 Docs: <a href="https://oss-docs.rapidfire.ai/" target="_blank" rel="noopener noreferrer">https://oss-docs.rapidfire.ai/</a></li> |
|
|
<li>🌐 Company website: <a href="https://rapidfire.ai/" target="_blank" rel="noopener noreferrer">https://rapidfire.ai/</a></li> |
|
|
<li> |
|
|
<a href="https://discord.gg/6vSTtncKNN" target="_blank" rel="noopener noreferrer"> |
|
|
<img src="images/discord-button.svg" alt="Join our Discord" style="height: 32px; vertical-align: middle;" /> |
|
|
</a> |
|
|
</li> |
|
|
</ul> |
|
|
|
|
|
<p>We hope you enjoy the power of rapid experimentation with RapidFire AI for your LLM customization projects! We'd love to hear your feedback–both positive and negative–on the UX and UI, API, any rough edges, and what integrations and extensions you'd be excited to see.</p> |
|
|
</main> |
|
|
</body> |
|
|
</html> |
|
|
|
