Commit Graph

Select branches

Hide Pull Requests

ColossalChat

Yanjia0-patch-1

Yanjia0-patch-2

ckpt_api

cloud/coati

colossalchat

colossalchat_upgrade

dev/gpt2_metainfo_patch

dev/zero-offload

develop

feat/agpo

feat/boxed-version

feat/grpo

feat/hybrid_model_sync

feat/online-serving

feat/ppo

feat/speculative-decoding

feature/2-stage

feature/async-io

feature/colossal-infer

feature/dist-ckp-io

feature/dualpipe

feature/elixir

feature/inference-refactor

feature/lora

feature/ray-rlhf

feature/stable-diffusion

feature/zerobubble

fix-setup

flybird11111-patch-1

grpo-agentic-dev

grpo-code

grpo-dev

grpo-latest

grpo-latest-ascend

grpo-latest-dev

grpo-latest-dev-debug

grpo-latest-dev-reward-update

grpo-latest-rebase-main

grpo-latest-revert

grpo-latest-support-entropy-metric

grpo-latest-v3

grpo-profile

grpo-reward-dev

grpo-support-multi-machine

grpo-zero-bubble

grpo-zero-bubble-rebase

grpo_optimization

hotfix/example_test

hotfix/kernel_build_before_load

hotfix/tp-issue

hpc-ai-cloud

main

moe_sp

pre-commit-ci-update-config

refactor/inference

release/v0.5.0

revert-6292-grpo-latest-dev-reward-update

supercooledith-patch-1

support-npu

upgrade_transformers

uxsqN94oMfWTUNCA

#10

#100

#1000

#1001

#1003

#1004

#1005

#1007

#1008

#1009

#101

#1010

#1011

#1012

#1015

#1016

#1017

#1018

#1019

#1020

#1021

#1022

#1024

#1025

#1026

#1027

#1029

#1030

#1031

#1034

#1040

#1041

#1042

#1044

#1045

#1046

#1047

#1048

#1049

#1050

#1052

#1053

#1054

#1059

#1062

#1063

#1066

#1068

#1069

#1070

#1071

#1072

#1073

#1075

#1076

#1077

#1078

#108

#1080

#1081

#1086

#1087

#1088

#1089

#1090

#1091

#1093

#1094

#1096

#1097

#1098

#1099

#11

#1100

#1101

#1102

#1103

#1105

#1106

#1108

#111

#1115

#1117

#1118

#1119

#112

#1120

#1121

#1122

#1123

#1125

#1127

#1128

#1129

#113

#1130

#1131

#1133

#1134

#1135

#1136

#1137

#1138

#1139

#114

#1140

#1142

#1143

#1144

#1145

#1146

#1147

#1148

#115

#1150

#1151

#1152

#1153

#1154

#1155

#1156

#1157

#1158

#1159

#1160

#1161

#1163

#1164

#1165

#1166

#1167

#1168

#1169

#1170

#1171

#1172

#1173

#1174

#1175

#1176

#1177

#1178

#1179

#118

#1181

#1182

#1185

#1186

#1187

#1188

#1189

#1191

#1192

#1193

#1194

#1196

#1197

#1198

#1199

#12

#1200

#1201

#1202

#1203

#1204

#1207

#1208

#1209

#1210

#1211

#1212

#1213

#1214

#1215

#1216

#1217

#1219

#1220

#1221

#1222

#1223

#1224

#1225

#1226

#1227

#1228

#1229

#123

#1230

#1231

#1232

#1233

#1234

#1235

#1236

#1237

#1238

#1239

#1240

#1241

#1242

#1243

#1244

#1245

#1246

#1247

#1248

#1248

#125

#1250

#1251

#1252

#1253

#1254

#1255

#1256

#1257

#1258

#1259

#126

#1260

#1261

#1262

#1263

#1264

#1265

#1266

#1267

#1268

#1269

#127

#1270

#1271

#1272

#1273

#1274

#1275

#1276

#1277

#1278

#1279

#128

#1280

#1281

#1282

#1283

#1284

#1285

#1286

#1287

#1288

#1288

#1289

#129

#1290

#1291

#1292

#1293

#1294

#1295

#1296

#1297

#1298

#1299

#13

#130

#1300

#1301

#1302

#1303

#1305

#1306

#1307

#1308

#1309

#1310

#1311

#1312

#1313

#1314

#1315

#1316

#1318

#1319

#132

#1320

#1321

#1323

#1324

#1325

#1326

#1327

#1328

#1329

#133

#1331

#1332

#1333

#1334

#1335

#1336

#1338

#1339

#1340

#1342

#1343

#1344

#1345

#1346

#1347

#1348

#1349

#135

#1350

#1351

#1352

#1353

#1354

#1355

#1357

#1358

#1359

#1360

#1361

#1362

#1363

#1364

#1366

#1367

#1368

#1369

#137

#1370

#1372

#1373

#1374

#1376

#1377

#1378

#1379

#138

#1380

#1381

#1382

#1383

#1384

#1385

#1386

#1387

#1388

#1391

#1392

#1393

#1394

#1395

#1396

#1397

#1398

#1399

#14

#140

#1403

#1404

#1405

#1406

#1407

#1408

#1409

#141

#1410

#1415

#1416

#1417

#1418

#1419

#142

#1421

#1422

#1423

#1424

#1425

#1426

#1428

#1429

#143

#1430

#1431

#1432

#1433

#1435

#1436

#1437

#1438

#1439

#144

#1441

#1442

#1444

#1446

#1447

#1448

#1449

#145

#1450

#1451

#1452

#1453

#1456

#1457

#1458

#1459

#146

#1460

#1461

#1462

#1463

#1464

#1465

#1466

#1467

#1468

#1469

#147

#1470

#1471

#1472

#1473

#1475

#1476

#1477

#1478

#1479

#148

#1480

#1481

#1482

#1483

#1484

#1486

#1487

#1488

#1489

#1490

#1492

#1493

#1494

#1495

#1496

#1497

#1499

#15

#1500

#1501

#1502

#1503

#1504

#1505

#1506

#1507

#1508

#1509

#151

#1510

#1511

#1512

#1513

#1514

#1515

#1516

#1518

#1519

#152

#1520

#1521

#1522

#1523

#1524

#1525

#1526

#1527

#1528

#1529

#153

#1530

#1531

#1532

#1533

#1534

#1535

#1536

#1537

#1538

#1539

#154

#1541

#1542

#1543

#1544

#1545

#1546

#1547

#1548

#1549

#1550

#1551

#1552

#1553

#1554

#1555

#1556

#1557

#1558

#1559

#156

#1560

#1561

#1562

#1563

#1564

#1565

#1566

#1567

#1568

#1569

#157

#1570

#1571

#1572

#1573

#1574

#1575

#1576

#1578

#1581

#1583

#1584

#1585

#1586

#1587

#1588

#1589

#159

#1590

#1591

#1594

#1595

#1596

#1597

#1598

#1599

#160

#1600

#1601

#1602

#1603

#1604

#1605

#1606

#1607

#1608

#1609

#161

#1610

#1611

#1612

#1613

#1614

#1615

#1616

#1617

#1618

#1619

#162

#1620

#1621

#1622

#1623

#1624

#1625

#1628

#1629

#163

#1630

#1631

#1633

#1634

#1635

#1636

#1637

#1638

#1639

#164

#1640

#1641

#1642

#1643

#1644

#1645

#1646

#1647

#1648

#1649

#165

#1650

#1651

#1652

#1653

#1654

#1655

#1656

#1657

#1658

#1659

#166

#1660

#1661

#1662

#1663

#1664

#1665

#1666

#1667

#1669

#167

#1670

#1671

#1673

#1674

#1676

#1677

#1678

#1679

#168

#1680

#1681

#1682

#1683

#1684

#1686

#1687

#1688

#1689

#1690

#1691

#1692

#1694

#1695

#1696

#1697

#1698

#1699

#17

#1700

#1701

#1702

#1703

#1704

#1705

#1706

#1707

#1708

#1709

#171

#1710

#1711

#1712

#1713

#1714

#1715

#1716

#1717

#1718

#1719

#172

#1720

#1721

#1722

#1723

#1724

#1725

#1726

#1727

#1728

#1729

#173

#1730

#1731

#1732

#1733

#1734

#1735

#1736

#1739

#174

#1740

#1741

#1742

#1743

#1744

#1745

#1746

#1747

#1748

#1750

#1751

#1752

#1753

#1754

#1755

#1757

#1758

#1759

#176

#1760

#1762

#1763

#1764

#1765

#1766

#1767

#1768

#1769

#1770

#1771

#1772

#1775

#1776

#1778

#178

#1780

#1781

#1782

#1783

#1784

#1785

#1786

#1787

#1788

#1789

#179

#1790

#1791

#1792

#1793

#1796

#1797

#1798

#1799

#18

#1800

#1801

#1802

#1803

#1804

#1805

#1806

#1807

#1808

#1809

#1810

#1811

#1812

#1813

#1814

#1815

#1816

#1817

#1818

#1819

#1820

#1821

#1822

#1823

#1824

#1825

#1826

#1827

#1828

#1829

#183

#1830

#1831

#1832

#1833

#1834

#1835

#1836

#1837

#184

#1840

#1842

#1843

#1844

#1845

#1846

#1847

#1848

#1849

#1851

#1852

#1853

#1854

#1855

#1856

#1857

#1858

#1859

#186

#1860

#1865

#1866

#1867

#1868

#1869

#187

#1871

#1873

#1874

#1875

#1876

#1877

#1878

#1879

#188

#1880

#1889

#189

#1891

#1893

#1894

#1895

#1896

#1897

#1898

#1899

#19

#190

#1901

#1902

#1903

#1904

#1905

#1906

#1907

#1908

#1909

#191

#1910

#1916

#1917

#1918

#1919

#192

#1920

#1921

#1922

#1924

#1925

#1927

#1928

#193

#1930

#1931

#1937

#1938

#1939

#194

#1940

#1941

#1942

#1943

#1944

#1946

#1950

#1950

#1952

#1953

#1954

#1955

#1957

#1958

#1959

#196

#1960

#1961

#1962

#1963

#1964

#1967

#1968

#197

#1970

#1971

#1972

#1973

#1974

#1977

#1978

#1979

#198

#1980

#1981

#1982

#1984

#1985

#1986

#1987

#1989

#1990

#1998

#1999

#2

#20

#200

#2000

#2001

#2002

#2003

#2004

#2005

#2006

#2007

#2008

#2009

#201

#2010

#2011

#2015

#2016

#2017

#2018

#2019

#202

#2020

#2021

#2021

#2022

#2023

#2025

#2027

#2028

#2029

#203

#2030

#2032

#2033

#2034

#2035

#2036

#2037

#2038

#2039

#204

#2040

#2042

#2043

#2045

#2046

#2047

#2048

#205

#2050

#2051

#2052

#2053

#2058

#2059

#2060

#2061

#2062

#2064

#2065

#2066

#2069

#2071

#2072

#2073

#2074

#2075

#2076

#2077

#2078

#2079

#2080

#2081

#2082

#2083

#2084

#2085

#2086

#2087

#2088

#2089

#209

#2090

#2091

#2092

#2095

#2096

#2097

#2098

#2099

#21

#210

#2101

#2102

#2103

#2104

#2105

#2106

#2107

#2108

#2110

#2111

#2112

#2113

#2115

#2116

#2117

#2118

#2119

#212

#2120

#2123

#2124

#2125

#2126

#2127

#2128

#2129

#213

#2130

#2131

#2132

#2133

#2134

#2136

#2137

#2138

#2139

#214

#2144

#2146

#2147

#2148

#2149

#215

#2150

#2151

#2152

#2153

#2154

#2155

#2156

#2157

#2158

#2159

#2162

#2163

#2164

#2165

#2167

#2168

#2168

#2169

#217

#2171

#2172

#2173

#2174

#2175

#2177

#2178

#2179

#218

#2184

#2186

#2187

#2188

#2189

#219

#2190

#2191

#2193

#2194

#2195

#2196

#2197

#220

#2200

#2201

#2202

#2203

#2206

#2207

#2208

#2209

#221

#2210

#2211

#2212

#2213

#2214

#2216

#2217

#2219

#222

#2221

#2222

#2223

#2224

#2225

#2226

#2227

#2228

#2229

#223

#2231

#2232

#2234

#2237

#2238

#2239

#224

#2242

#2243

#2244

#2245

#2247

#2248

#2254

#2257

#2258

#226

#2261

#2262

#2263

#2264

#2265

#2266

#2267

#2268

#2268

#2269

#227

#2270

#2271

#2272

#2273

#2274

#2275

#2276

#2277

#2278

#2279

#2280

#2281

#2282

#2283

#2284

#2286

#2287

#2288

#2289

#229

#2290

#2291

#2292

#2293

#2295

#2296

#2297

#2298

#2299

#23

#2300

#2301

#2302

#2303

#2304

#2305

#2306

#2307

#2308

#2310

#2311

#2312

#2313

#2314

#2315

#2316

#2317

#2318

#2319

#232

#2320

#2322

#2323

#2326

#2327

#2328

#2329

#233

#2333

#2336

#2338

#2339

#2340

#2342

#2344

#2345

#2348

#2349

#2350

#2352

#2353

#2354

#2355

#2356

#2357

#2358

#2359

#2363

#2364

#2365

#2366

#2367

#2368

#2370

#2371

#2372

#2373

#2374

#2375

#2379

#2381

#2385

#2387

#2389

#2390

#2393

#2395

#2396

#2396

#2397

#2399

#24

#240

#2400

#2401

#2403

#2404

#2405

#2406

#2408

#2410

#2411

#2412

#2413

#2414

#2415

#2416

#2417

#2418

#2419

#242

#2420

#2423

#2424

#2427

#243

#2431

#2432

#2434

#2436

#2438

#244

#2442

#2443

#2444

#2445

#2446

#2448

#2449

#245

#2451

#2452

#2453

#2456

#2459

#246

#2463

#2464

#2465

#2466

#2468

#2469

#2471

#2473

#2474

#2475

#2476

#2477

#248

#2481

#2482

#2483

#2484

#2485

#2486

#2488

#249

#2492

#2494

#2495

#2497

#2498

#2499

#25

#2502

#2503

#2504

#2506

#2507

#2508

#2509

#251

#2510

#2511

#2512

#2514

#2515

#2516

#2517

#2518

#2519

#252

#2520

#2521

#2522

#2523

#2524

#2525

#2526

#2527

#2528

#2529

#253

#2532

#2533

#2534

#2537

#2538

#2540

#2543

#2544

#2545

#2549

#255

#2550

#2552

#2554

#2556

#2558

#2560

#2561

#2564

#2565

#2567

#2568

#2572

#2574

#2577

#2578

#2581

#2584

#2585

#2586

#2589

#2591

#2594

#2596

#2598

#2600

#2601

#2602

#2604

#2607

#2608

#2611

#2613

#2614

#2615

#2618

#2619

#2621

#2623

#2624

#2625

#2626

#263

#2635

#2637

#264

#2641

#2643

#2644

#2647

#2648

#265

#2652

#2656

#2657

#2658

#2659

#266

#2661

#2664

#2665

#2666

#2669

#267

#2670

#2671

#2672

#2674

#2675

#2678

#268

#2680

#2681

#2683

#2686

#2687

#2689

#2689

#269

#2690

#2691

#2692

#2693

#2694

#2695

#2696

#2698

#2699

#27

#270

#2700

#2701

#2701

#2702

#2702

#2703

#2704

#2705

#2706

#2707

#2708

#2709

#271

#2711

#2712

#2713

#2714

#2715

#2716

#2717

#2719

#272

#2720

#2721

#2723

#2725

#2726

#2727

#2728

#273

#2730

#2734

#2736

#2737

#2738

#274

#2740

#2741

#2742

#2744

#2747

#2749

#2749

#275

#2754

#276

#2760

#2762

#2764

#2766

#2767

#2769

#277

#2773

#2775

#2777

#2789

#279

#2791

#2792

#2796

#2797

#2798

#28

#280

#2803

#2804

#281

#2812

#2813

#2817

#282

#2820

#2821

#2822

#2823

#2824

#2826

#2829

#283

#2835

#2837

#284

#2846

#2848

#2849

#285

#2852

#2854

#286

#2860

#2863

#2867

#2869

#287

#2871

#2876

#288

#2880

#2886

#2895

#29

#291

#2912

#2914

#292

#2920

#2922

#2923

#2925

#2927

#2929

#293

#2930

#2932

#2933

#2935

#2939

#294

#2944

#2946

#2951

#2954

#296

#2964

#2966

#2969

#297

#2971

#2974

#2977

#298

#2982

#2983

#2984

#2986

#2987

#2988

#299

#2993

#2994

#2996

#2997

#2999

#3

#30

#300

#3006

#3008

#301

#3014

#3017

#3019

#302

#3020

#3022

#3025

#3026

#3028

#3029

#303

#3032

#3034

#3037

#304

#3042

#305

#3055

#3056

#3057

#3058

#306

#3062

#3065

#307

#3070

#3072

#3073

#3075

#3079

#308

#3080

#3082

#3084

#3085

#3086

#3087

#3089

#309

#3093

#3094

#3098

#3099

#310

#3101

#3104

#3105

#3107

#3108

#311

#3113

#3116

#312

#3121

#3122

#3128

#3129

#313

#3131

#3132

#3133

#3135

#3136

#3138

#3139

#3147

#315

#3151

#3153

#3154

#3157

#3159

#316

#3162

#3166

#3167

#317

#3170

#3173

#3174

#3177

#3178

#3180

#3181

#3183

#3185

#3186

#3188

#3190

#3191

#3194

#3195

#3197

#3199

#32

#320

#3204

#3205

#3206

#3207

#3209

#321

#3211

#3213

#3216

#3218

#3219

#322

#3221

#3222

#3223

#3225

#3227

#3229

#323

#3230

#3232

#3233

#3236

#3238

#3239

#324

#3241

#3244

#325

#3253

#3254

#3255

#3256

#3257

#3259

#3260

#3261

#3262

#3263

#3265

#3266

#3268

#3269

#327

#3270

#3272

#3273

#3274

#3275

#3276

#3277

#3279

#328

#3282

#3283

#3284

#3285

#3286

#3287

#3288

#3289

#329

#3290

#3292

#3293

#3294

#3295

#3296

#3297

#3298

#3299

#33

#330

#3300

#3301

#3302

#3304

#3305

#3306

#3307

#3308

#3309

#331

#3311

#3312

#3313

#3315

#3318

#332

#3323

#3327

#3329

#333

#3332

#3333

#3338

#334

#3343

#3346

#3347

#335

#3352

#3354

#336

#3367

#3368

#337

#3377

#3378

#3379

#338

#3384

#3386

#339

#3398

#34

#340

#3405

#3408

#341

#3411

#3417

#3418

#342

#3420

#3424

#3427

#3429

#343

#3431

#3433

#3436

#344

#3442

#3445

#3448

#345

#3450

#3452

#3453

#346

#3461

#3465

#347

#3472

#3473

#3474

#3475

#3476

#3477

#3479

#348

#3481

#3486

#3488

#349

#3493

#3497

#35

#350

#3504

#3506

#351

#3513

#3516

#3517

#3519

#352

#3520

#3522

#3525

#353

#3536

#354

#3541

#3548

#3549

#355

#3551

#3552

#3553

#3557

#356

#3561

#3563

#3567

#3567

#3568

#357

#3572

#3573

#3577

#3578

#3579

#358

#3581

#3586

#3588

#3589

#359

#3590

#3592

#3593

#3594

#3596

#3597

#36

#360

#3603

#3605

#3608

#361

#3610

#3611

#3612

#3618

#3619

#362

#3621

#3623

#3625

#3627

#3628

#363

#3632

#364

#3641

#3645

#3646

#3647

#3648

#365

#3652

#3653

#3654

#3655

#3656

#366

#3662

#3663

#3666

#3667

#3668

#367

#3671

#3679

#368

#3680

#3684

#3688

#369

#3691

#3692

#3693

#3694

#3695

#3697

#3699

#3699

#370

#3706

#3707

#3709

#371

#3710

#3711

#3713

#3715

#3718

#3719

#372

#3722

#3725

#3727

#3728

#3729

#373

#3730

#3731

#3735

#374

#3740

#3742

#3744

#3748

#375

#3751

#3754

#3756

#3758

#3759

#376

#3763

#3765

#3767

#377

#3770

#3771

#3772

#3774

#3775

#3778

#3779

#378

#3780

#3781

#3782

#3783

#3785

#3786

#3787

#3788

#3789

#379

#3792

#3794

#3795

#3799

#38

#380

#3801

#3804

#3805

#3806

#3807

#3808

#3809

#381

#3810

#3813

#3815

#3816

#3817

#382

#3820

#3821

#3822

#3823

#3824

#3825

#3826

#3827

#3828

#3829

#383

#3830

#3831

#3833

#3834

#3835

#3838

#384

#3841

#3842

#3844

#3845

#3846

#3847

#3849

#385

#3850

#3855

#3856

#386

#3860

#3862

#3864

#3865

#3868

#3869

#387

#3871

#3872

#3873

#3877

#3878

#3879

#388

#3880

#3882

#3883

#3884

#3885

#3887

#389

#3890

#3891

#3896

#3898

#3899

#39

#390

#3900

#3901

#3902

#3905

#3907

#3908

#3909

#391

#3910

#3911

#3913

#3915

#3916

#3917

#3918

#3919

#392

#3920

#3922

#3923

#3924

#3925

#3926

#3928

#3929

#393

#3930

#3931

#3932

#3934

#3936

#3937

#3939

#394

#3940

#3942

#3943

#3944

#3946

#3947

#3949

#395

#3956

#3960

#3963

#3967

#3968

#3969

#397

#3970

#3972

#3976

#3976

#3979

#3980

#3984

#3985

#3987

#3988

#399

#3990

#3991

#3993

#3994

#3996

#3999

#4

#40

#400

#4001

#4002

#4004

#4006

#4006

#401

#4011

#4013

#4014

#4016

#4018

#4019

#402

#4020

#4021

#4022

#4024

#4025

#4026

#4028

#403

#4030

#4033

#4034

#4036

#4039

#404

#4041

#4043

#4045

#4046

#4046

#4047

#4048

#4049

#4053

#4055

#4056

#4058

#406

#4060

#4062

#4064

#4065

#4067

#4068

#4068

#4069

#407

#4070

#4072

#4073

#4075

#4079

#4080

#4081

#4082

#4083

#4086

#4087

#4089

#409

#4090

#4091

#4093

#4094

#4096

#4098

#41

#410

#4100

#4101

#4103

#4105

#4106

#4107

#4109

#411

#4111

#4112

#4115

#4117

#412

#4122

#4124

#4126

#4127

#4129

#413

#4130

#4132

#4137

#4138

#4139

#414

#4141

#4142

#4144

#4145

#4146

#4147

#4149

#4152

#4153

#4155

#4157

#4158

#4159

#416

#4160

#4161

#4162

#4163

#4165

#4166

#4167

#4169

#417

#4171

#4172

#4173

#4174

#4175

#4176

#4178

#4179

#418

#4180

#4182

#4185

#4187

#4188

#419

#4191

#4192

#4194

#4196

#4197

#42

#420

#4202

#4203

#4205

#4206

#4208

#421

#4210

#4212

#4213

#4214

#4215

#4216

#4217

#4218

#422

#4221

#4223

#4224

#4225

#4226

#4227

#4228

#4229

#423

#423

#4231

#4233

#4234

#4236

#4237

#4238

#4239

#424

#4240

#4241

#4243

#4244

#4245

#4246

#4248

#4250

#4251

#4252

#4253

#4254

#4255

#4256

#4257

#4258

#4259

#426

#4260

#4261

#4263

#4264

#4265

#4266

#4267

#4268

#4269

#427

#4270

#4271

#4272

#4273

#4274

#4275

#4276

#4277

#4278

#4279

#428

#4283

#4284

#4287

#4288

#429

#4290

#4291

#4293

#4295

#4297

#4299

#43

#430

#4300

#4301

#4302

#4303

#4305

#4306

#4307

#4309

#4309

#431

#4310

#4312

#4313

#4314

#4315

#4316

#4317

#432

#4320

#4321

#4323

#4324

#4325

#4329

#433

#4330

#4331

#4332

#4333

#4334

#4336

#4338

#434

#4340

#4341

#4345

#4346

#4347

#4349

#435

#4350

#4352

#4354

#4355

#4356

#4357

#4358

#4359

#436

#4362

#4363

#4366

#4369

#4372

#4377

#4379

#438

#4380

#4382

#4384

#4386

#4388

#4389

#439

#4392

#4395

#4396

#4398

#4399

#44

#440

#4401

#4403

#4404

#4405

#4407

#4408

#4409

#441

#4413

#4415

#4416

#442

#4420

#4421

#4423

#4424

#4426

#4426

#4428

#4429

#4430

#4431

#4432

#4433

#4434

#4435

#4436

#4440

#4441

#4443

#4445

#4446

#4448

#445

#4450

#4452

#4455

#4456

#4457

#4458

#446

#4460

#4461

#4462

#4463

#4465

#4466

#4468

#4469

#447

#4471

#4472

#4473

#4479

#448

#4480

#4481

#4482

#4484

#4485

#4488

#449

#4492

#4493

#4494

#4495

#4496

#4497

#4498

#4499

#45

#450

#4501

#4502

#4503

#4504

#4505

#4506

#4507

#4508

#4509

#451

#4511

#4512

#4514

#4516

#4517

#4519

#452

#4520

#4521

#4523

#4524

#4526

#4527

#4529

#453

#4531

#4532

#4533

#4535

#4536

#4538

#4539

#454

#4540

#4541

#4542

#4544

#4545

#4546

#4549

#455

#4550

#4552

#4553

#4554

#4555

#4556

#4557

#4558

#4559

#456

#4560

#4561

#4563

#4564

#4566

#4569

#457

#4570

#4571

#4572

#4574

#4575

#4576

#4577

#4579

#458

#4580

#4581

#4584

#4585

#4586

#4587

#4588

#4589

#459

#4591

#4592

#4593

#4593

#4595

#4597

#4598

#4599

#46

#460

#4600

#4601

#4602

#4603

#4604

#4606

#4608

#4609

#461

#4611

#4612

#4614

#4615

#4616

#4617

#4618

#4619

#462

#4620

#4621

#4622

#4623

#4624

#4627

#4629

#463

#4630

#4631

#4632

#4633

#4634

#4635

#4636

#4637

#464

#4640

#4641

#4642

#4645

#4646

#4647

#465

#4650

#4653

#4654

#4655

#4656

#4657

#4658

#4659

#4659

#4663

#4665

#4666

#4667

#4669

#467

#4670

#4671

#4672

#4673

#4674

#4676

#4678

#4680

#4683

#4684

#4685

#4686

#4689

#469

#4690

#4692

#4693

#4694

#4695

#4696

#4697

#4698

#4699

#47

#470

#4700

#4701

#4702

#4703

#4704

#4706

#4707

#4708

#4709

#471

#4710

#4712

#4713

#4715

#4716

#4718

#472

#4720

#4721

#4722

#4723

#4724

#4725

#4726

#4727

#4728

#4729

#473

#4730

#4731

#4732

#4733

#4734

#4735

#4736

#4738

#474

#4740

#4741

#4742

#4743

#4745

#4748

#4749

#475

#4750

#4752

#4753

#4754

#4755

#4757

#4758

#476

#4763

#4764

#4765

#4766

#4768

#477

#4770

#4771

#4772

#4773

#4774

#4775

#4777

#4778

#4779

#478

#4784

#4786

#4787

#4788

#4789

#479

#4790

#4791

#4792

#4793

#4794

#4795

#4796

#4798

#4799

#48

#480

#4800

#4801

#4802

#4804

#4805

#4807

#4808

#4809

#481

#4810

#4811

#4812

#4813

#4814

#4815

#4816

#4817

#4819

#482

#4820

#4821

#4822

#4823

#4824

#4825

#4827

#4828

#483

#4830

#4831

#4832

#4834

#4836

#4837

#4838

#484

#4840

#4841

#4842

#4843

#4846

#4849

#4849

#485

#4850

#4851

#4852

#4853

#4854

#4856

#4858

#486

#4860

#4861

#4864

#4866

#4869

#487

#4872

#4873

#4874

#4876

#4877

#4878

#488

#4883

#4884

#4886

#4887

#4889

#489

#4890

#4893

#4894

#4895

#4896

#4897

#4898

#49

#490

#4900

#4901

#4902

#4904

#4905

#4907

#4908

#4909

#491

#4910

#4911

#4914

#4915

#4916

#4917

#4918

#4919

#492

#4920

#4921

#4922

#4923

#4925

#4926

#4927

#4928

#493

#4932

#4933

#4934

#4935

#4936

#4937

#4938

#4940

#4942

#4943

#4945

#4946

#4947

#4948

#4949

#495

#4950

#4951

#4952

#4953

#4954

#4959

#496

#4963

#4965

#4966

#4967

#497

#4972

#4975

#4976

#4976

#4977

#4978

#498

#4981

#4982

#4983

#4988

#4989

#4990

#4991

#4992

#4993

#4995

#4996

#4998

#5

#50

#500

#5001

#5002

#5007

#5008

#5009

#501

#5012

#5014

#5015

#5017

#5018

#502

#5020

#5022

#5023

#5024

#5025

#503

#5031

#5032

#5033

#5035

#5036

#504

#5043

#5044

#5046

#5047

#5048

#505

#5051

#5052

#5053

#5055

#5057

#5058

#5059

#506

#5060

#5062

#5063

#5064

#5065

#5067

#5069

#507

#5070

#5071

#5072

#5073

#5074

#5076

#5077

#5078

#5079

#508

#5080

#5081

#5082

#5082

#5084

#5085

#5086

#5087

#5088

#5089

#509

#5090

#5092

#5093

#5095

#5096

#5097

#5098

#5099

#51

#510

#5100

#5102

#5103

#5105

#5106

#5107

#511

#5111

#5112

#5113

#5114

#5115

#5116

#5117

#5118

#512

#5120

#5120

#5121

#5122

#5123

#5124

#5125

#5127

#5128

#5129

#513

#5130

#5131

#5132

#5133

#5134

#5135

#5138

#514

#5140

#5141

#5143

#5146

#5147

#5148

#5149

#515

#5150

#5153

#5155

#5155

#5156

#5157

#5158

#5159

#516

#5160

#5160

#5161

#5162

#5164

#5165

#5166

#5169

#517

#5170

#5171

#5172

#5173

#5176

#5177

#5178

#518

#5181

#5183

#5186

#5189

#519

#5190

#5192

#5194

#5196

#5199

#52

#520

#5201

#5202

#5206

#5207

#5209

#521

#5210

#5214

#5216

#5217

#5219

#522

#5224

#5225

#5227

#5228

#5229

#5230

#5231

#5232

#5233

#5234

#5235

#5236

#5237

#5238

#5239

#5240

#5241

#5242

#5246

#5247

#5248

#5248

#5249

#525

#5250

#5251

#5252

#5253

#5254

#5255

#5256

#5257

#5258

#5258

#526

#5260

#5261

#5262

#5263

#5264

#5265

#5265

#5267

#5267

#5268

#5269

#527

#5270

#5272

#5273

#5274

#5275

#5276

#5277

#5278

#5279

#528

#5280

#5281

#5282

#5283

#5284

#5285

#5286

#5287

#5288

#5289

#529

#5291

#5292

#5294

#5294

#5295

#5296

#5297

#5298

#5299

#53

#530

#5301

#5302

#5303

#5304

#5306

#5307

#5308

#5309

#531

#5310

#5311

#5313

#5314

#5315

#5316

#5317

#5318

#532

#5320

#5321

#5322

#5324

#5325

#5326

#5327

#5329

#533

#5330

#5331

#5332

#5333

#5334

#5335

#5336

#5337

#5338

#5339

#5340

#5341

#5342

#5343

#5344

#5345

#5346

#5347

#5348

#5349

#535

#5350

#5351

#5352

#5353

#5354

#5355

#5356

#5357

#5358

#536

#5360

#5361

#5362

#5363

#5364

#5365

#5366

#5367

#5368

#5369

#537

#5371

#5372

#5373

#5374

#5375

#5376

#5377

#5378

#5379

#538

#5380

#5382

#5383

#5384

#5386

#5388

#5389

#539

#5390

#5392

#5395

#5396

#5398

#5399

#54

#540

#5400

#5401

#5402

#5403

#5404

#5405

#5406

#5407

#5408

#541

#5411

#5412

#5413

#5415

#5416

#5417

#5418

#542

#5420

#5422

#5423

#5424

#5425

#5427

#5428

#5429

#543

#5430

#5431

#5432

#5433

#5434

#5435

#5437

#5438

#5440

#5441

#5442

#5444

#5445

#5446

#5447

#5448

#5449

#545

#5451

#5452

#5454

#5455

#5456

#5457

#546

#5460

#5461

#5462

#5465

#5468

#5469

#547

#5470

#5471

#5472

#5473

#5476

#5477

#5477

#5479

#548

#5480

#5484

#5485

#5486

#5486

#5489

#549

#5490

#5491

#5493

#5493

#5495

#5496

#5497

#5498

#5499

#55

#5500

#5501

#5502

#5503

#5504

#5506

#5508

#551

#5510

#5511

#5512

#5514

#5515

#5517

#5518

#5519

#552

#5520

#5522

#5523

#5524

#5525

#5526

#5528

#5529

#553

#5530

#5531

#5532

#5533

#5535

#5537

#554

#5541

#5543

#5544

#5545

#5546

#5548

#555

#5550

#5551

#5552

#5554

#5556

#5557

#5558

#5559

#556

#5561

#5563

#5565

#5566

#5567

#5568

#5569

#5570

#5572

#5574

#5575

#5576

#5577

#5578

#5579

#558

#5580

#5581

#5582

#5583

#5584

#5586

#5588

#5589

#559

#5590

#5591

#5592

#5593

#5596

#5598

#5599

#5602

#5603

#5604

#5605

#5606

#5607

#5608

#5609

#561

#5610

#5611

#5612

#5613

#5614

#5619

#5620

#5621

#5622

#5623

#5624

#5625

#5626

#5627

#5628

#5629

#563

#5630

#5631

#5632

#5633

#5634

#5635

#5636

#5637

#5638

#5639

#564

#5640

#5642

#5643

#5644

#5645

#5646

#5647

#5648

#5649

#565

#5650

#5651

#5652

#5653

#5654

#5655

#5656

#5657

#5658

#5659

#566

#5660

#5660

#5661

#5663

#5665

#5666

#5668

#5668

#567

#5670

#5674

#5675

#5676

#5677

#5678

#5679

#568

#5680

#5681

#5682

#5684

#5685

#5686

#5687

#5688

#5689

#569

#5690

#5691

#5692

#5693

#5694

#5695

#5696

#5697

#5698

#5699

#57

#570

#5700

#5701

#5702

#5703

#5704

#5705

#5706

#5707

#5708

#571

#5710

#5711

#5712

#5713

#5714

#5715

#5715

#5716

#5717

#5719

#572

#5720

#5722

#5723

#5724

#5725

#5727

#573

#5730

#5731

#5733

#5734

#5735

#5736

#5737

#5738

#5739

#574

#5740

#5741

#5742

#5743

#5744

#5745

#5746

#5747

#5748

#5749

#575

#5750

#5751

#5752

#5753

#5754

#5755

#5756

#5756

#5758

#5759

#576

#5760

#5761

#5763

#5764

#5765

#5766

#5767

#5769

#577

#5770

#5771

#5772

#5774

#5775

#5776

#5777

#5779

#578

#5780

#5781

#5782

#5783

#5784

#5785

#5786

#5787

#5788

#5789

#579

#5790

#5791

#5793

#5794

#5796

#5797

#5799

#58

#580

#5800

#5801

#5802

#5803

#5804

#5806

#5807

#5808

#5809

#581

#5810

#5811

#5812

#5813

#5814

#5815

#5816

#5817

#5818

#5819

#582

#5820

#5821

#5822

#5823

#5824

#5825

#5827

#5828

#5829

#583

#5832

#5833

#5835

#5836

#5837

#5838

#5839

#584

#5840

#5842

#5843

#5844

#5845

#5846

#5847

#5848

#5849

#585

#5850

#5851

#5852

#5854

#5856

#5857

#5858

#5859

#586

#5860

#5862

#5863

#5864

#5867

#5868

#5870

#5871

#5872

#5874

#5875

#5876

#5877

#5877

#5878

#5879

#5881

#5882

#5883

#5884

#5885

#5888

#5889

#589

#5891

#5892

#5893

#5894

#5895

#5896

#5897

#5898

#5899

#59

#590

#5901

#5902

#5903

#5904

#5905

#591

#5910

#5911

#5912

#5917

#5918

#5919

#592

#5921

#5922

#5923

#5924

#5925

#5928

#593

#5931

#5932

#5934

#5936

#5938

#5939

#5939

#594

#5941

#5942

#5944

#5945

#5946

#5947

#595

#5950

#5951

#5952

#5953

#5956

#5957

#5958

#5959

#596

#5961

#5962

#5963

#5966

#5967

#5968

#597

#5970

#5973

#5975

#5976

#5977

#5978

#5979

#598

#5980

#5981

#5982

#5984

#5985

#5989

#599

#5990

#5991

#5993

#5994

#5995

#5997

#5998

#6

#60

#6000

#6001

#6002

#6003

#6004

#6005

#6006

#6007

#6008

#6009

#601

#6010

#6011

#6012

#6013

#6014

#6015

#6015

#6016

#6017

#6018

#6020

#6022

#6023

#6024

#6026

#6029

#603

#6030

#6031

#6033

#6034

#6035

#6036

#6038

#604

#6040

#6041

#6042

#6043

#6044

#6045

#6046

#6048

#6050

#6051

#6052

#6053

#6054

#6055

#6056

#6057

#6059

#6060

#6061

#6062

#6063

#6064

#6065

#6068

#6069

#607

#6070

#6071

#6072

#6073

#6073

#6074

#6075

#6077

#6078

#608

#6080

#6081

#6082

#6083

#6084

#6085

#6086

#6087

#6088

#6089

#609

#6090

#6092

#6093

#6094

#6096

#6098

#6099

#61

#610

#6100

#6104

#6106

#6107

#6109

#611

#6113

#6114

#6115

#6116

#6117

#6118

#6118

#6119

#612

#6121

#6122

#6122

#6123

#6124

#6124

#6125

#6126

#6127

#6127

#6128

#6129

#613

#6130

#6131

#6132

#6134

#6135

#6136

#6137

#6139

#614

#6140

#6141

#6142

#6143

#6144

#6145

#6146

#6147

#6148

#6149

#615

#6150

#6151

#6152

#6153

#6154

#6155

#6156

#6158

#6158

#6159

#616

#6162

#6162

#6163

#6164

#6165

#6166

#6168

#617

#6172

#6173

#6173

#6174

#6177

#6178

#6179

#6179

#618

#6181

#6181

#6183

#6184

#6185

#6186

#6187

#6188

#6189

#619

#6191

#6192

#6195

#6196

#6198

#6199

#62

#620

#6206

#6208

#621

#6210

#6213

#6214

#6218

#622

#6223

#6223

#6228

#6229

#623

#6230

#6231

#6236

#624

#6240

#6242

#6245

#6246

#6247

#625

#6250

#6251

#6252

#6254

#6255

#6257

#6258

#626

#6262

#6263

#6268

#6269

#627

#6270

#6271

#6273

#6274

#6275

#6276

#6277

#6278

#6278

#6279

#628

#6280

#6282

#6283

#6284

#6285

#6286

#6287

#6288

#6289

#629

#6290

#6291

#6292

#6293

#6294

#6295

#6296

#6297

#6298

#6299

#63

#630

#6300

#6301

#6302

#6303

#6304

#6305

#6306

#6307

#6308

#6309

#631

#6310

#6311

#6312

#6313

#6314

#6315

#6316

#6317

#6318

#6319

#632

#6320

#6321

#6322

#6323

#6324

#6325

#6326

#6327

#6328

#6329

#633

#6330

#6331

#6332

#6333

#6333

#6334

#6335

#6336

#6337

#6338

#6339

#634

#6340

#6341

#6343

#6344

#6346

#6347

#6348

#635

#6351

#6352

#6353

#6354

#6354

#6355

#6356

#6357

#636

#6360

#6361

#6362

#6363

#6364

#6366

#6368

#6368

#637

#6370

#6372

#6373

#6373

#6374

#6374

#6375

#6376

#6377

#6377

#6378

#638

#6383

#6384

#6384

#6385

#639

#6391

#6392

#6393

#6393

#6394

#6394

#6395

#6395

#6398

#6398

#64

#640

#6404

#6404

#6405

#6405

#6406

#6406

#6407

#6407

#6408

#641

#6410

#6411

#6412

#6414

#6414

#6415

#6415

#6416

#6417

#6418

#6418

#6419

#6419

#642

#6420

#6420

#6421

#6421

#6422

#6422

#6423

#6423

#645

#646

#647

#648

#649

#649

#65

#652

#655

#656

#657

#659

#66

#660

#661

#662

#664

#666

#667

#668

#67

#672

#673

#678

#679

#681

#683

#686

#687

#69

#691

#692

#694

#695

#699

#7

#70

#700

#701

#704

#705

#706

#707

#708

#71

#710

#711

#712

#715

#717

#717

#719

#72

#721

#723

#724

#725

#726

#727

#728

#729

#73

#730

#731

#732

#735

#738

#739

#74

#740

#741

#742

#743

#746

#747

#748

#749

#75

#750

#751

#752

#753

#754

#756

#758

#76

#760

#762

#763

#764

#765

#766

#769

#77

#770

#771

#772

#773

#775

#777

#779

#78

#781

#783

#784

#785

#788

#789

#79

#790

#791

#792

#793

#795

#797

#798

#799

#8

#80

#800

#801

#802

#803

#804

#805

#806

#807

#808

#809

#81

#810

#811

#812

#813

#815

#816

#818

#819

#82

#820

#821

#822

#823

#824

#825

#826

#827

#828

#829

#83

#830

#831

#832

#833

#834

#835

#837

#838

#839

#84

#840

#842

#843

#844

#845

#846

#847

#848

#849

#850

#852

#853

#854

#855

#856

#857

#858

#859

#86

#860

#861

#862

#863

#864

#865

#866

#867

#868

#869

#87

#870

#871

#872

#873

#874

#875

#876

#877

#878

#879

#88

#880

#881

#886

#887

#888

#889

#890

#893

#894

#895

#896

#897

#898

#899

#9

#90

#900

#901

#902

#903

#904

#905

#907

#909

#91

#910

#911

#912

#913

#914

#915

#916

#917

#918

#919

#92

#920

#921

#922

#923

#927

#928

#929

#93

#931

#932

#933

#934

#935

#936

#937

#938

#939

#94

#940

#941

#942

#943

#944

#945

#946

#947

#948

#949

#95

#950

#951

#952

#953

#954

#955

#956

#957

#958

#959

#96

#960

#961

#962

#963

#964

#965

#966

#967

#968

#969

#97

#970

#971

#972

#973

#974

#975

#976

#977

#978

#979

#98

#980

#981

#982

#983

#984

#986

#987

#99

#992

#997

#998

#999

v0.0.1-beta

v0.0.2

v0.1.0

v0.1.1

v0.1.10

v0.1.11rc1

v0.1.11rc2

v0.1.11rc3

v0.1.11rc4

v0.1.11rc5

v0.1.12

v0.1.13

v0.1.2

v0.1.3

v0.1.4

v0.1.5

v0.1.6

v0.1.7

v0.1.8

v0.1.9

v0.2.0

v0.2.1

v0.2.2

v0.2.3

v0.2.4

v0.2.5

v0.2.6

v0.2.7

v0.2.8

v0.3.0

v0.3.1

v0.3.2

v0.3.3

v0.3.4

v0.3.5

v0.3.6

v0.3.7

v0.3.8

v0.3.9

v0.4.0

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.4.5

v0.4.6

v0.4.7

v0.4.8

v0.4.9

v0.5.0

v0.5.1

Mono Color

• 3420921101 [shardformer] DeepseekMoE support (#5871) Haze188 2024-07-05 16:13:58 +08:00
• e17f835df7 [pre-commit.ci] auto fixes from pre-commit.com hooks pre-commit-ci[bot] 2024-07-04 12:47:16 +00:00
• 6991819a97 Merge branch 'hpcaitech:main' into feature/fp8_comm Hanks 2024-07-04 20:34:41 +08:00
• 7997683aac [pre-commit.ci] pre-commit autoupdate (#5878) pre-commit-ci[bot] 2024-07-04 13:46:41 +08:00
• 7afbc81d62 [quant] fix bitsandbytes version check (#5882) Hongxin Liu 2024-07-04 11:33:23 +08:00
• 6cd4c32be4 [shardformer] fix the moe (#5883) Wang Binluo 2024-07-03 20:02:19 +08:00
• eb24fcd914 [Hotfix] Fix OPT gradient checkpointing forward Edenzzzz 2024-07-03 14:57:57 +08:00
• ea94c07b95 [hotfix] fix the bug that large tensor exceed the maximum capacity of TensorBucket (#5879) Haze188 2024-07-02 12:42:02 +08:00
• 7c2f79fa98 [pre-commit.ci] pre-commit autoupdate (#5572) pre-commit-ci[bot] 2024-07-01 17:16:41 +08:00
• 936d0b0f7b [doc] Update llama + sp compatibility; fix dist optim table Edenzzzz 2024-07-01 17:07:22 +08:00
• 8ab46b4000 [Shardformer] change qwen2 modeling into gradient checkpointing style (#5874) Jianghai 2024-07-01 16:45:09 +08:00
• f5a52e1600 fp8 operators for compressed communication HangXu 2024-07-01 13:44:21 +08:00
• ff535204fe update transformers version YeAnbang 2024-06-28 06:24:30 +00:00
• 416580b314 [MoE/ZeRO] Moe refactor with zero refactor (#5821) Haze188 2024-06-28 14:00:08 +08:00
• a8af6ccb73 fix torch colossalai version YeAnbang 2024-06-28 03:58:29 +00:00
• 773d9f964a [shardformer]delete xformers (#5859) flybird11111 2024-06-28 11:20:04 +08:00
• e7527762a1 Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into rlhf_SimPO YeAnbang 2024-06-28 02:50:14 +00:00
• eaea88cf9e [release] update version (#5864) v0.4.0 Hongxin Liu 2024-06-28 10:49:55 +08:00
• 3c7cda0c9a [Inference]Lazy Init Support (#5785) Runyu Lu 2024-06-27 18:02:15 +08:00
• d9d5e7ea1f [shardformer] Support the T5ForTokenClassification model (#5816) Guangyao Zhang 2024-06-27 16:40:38 +08:00
• 5dfbcd7746 [zero] use bucket during allgather (#5860) Hongxin Liu 2024-06-27 16:34:44 +08:00
• b117274074 fix colossalai, transformers version YeAnbang 2024-06-27 08:30:17 +00:00
• afa53066ca fix colossalai, transformers version YeAnbang 2024-06-27 08:28:36 +00:00
• 384c64057d fix colossalai, transformers version YeAnbang 2024-06-27 08:26:44 +00:00
• 8aad064fe7 fix style YeAnbang 2024-06-27 07:29:33 +00:00
• c8d1b4a968 add orpo YeAnbang 2024-06-27 07:20:28 +00:00
• 868afdb311 Dev/zero offload (#5858) dev/zero-offload Wang Binluo 2024-06-26 16:07:06 +08:00
• 8e718a1421 [gemini] fixes for benchmarking (#5847) botbw 2024-06-26 15:52:09 +08:00
• 2a25a2aff7 [Feature] optimize PP overlap (#5735) Edenzzzz 2024-06-26 14:48:02 +08:00
• de3f67d128 fix llama (#5856) Wang Binluo 2024-06-26 10:15:13 +08:00
• 4ccaaaab63 [doc] add GPU cloud playground (#5851) binmakeswell 2024-06-25 11:03:16 +08:00
• f3de5a025c remove debug code YeAnbang 2024-06-24 05:16:29 +00:00
• 0b2d6275c4 fix dataloader YeAnbang 2024-06-24 05:10:44 +00:00
• 4b59d874df Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into main YeAnbang 2024-06-24 02:16:03 +00:00
• 82aecd6374 add SimPO colossalchat_upgrade YeAnbang 2024-06-24 02:12:20 +00:00
• 7266f82d03 [doc] fix open sora model weight link (#5848) binmakeswell 2024-06-21 22:48:34 +08:00
• 8f445729a4 [doc] opensora v1.2 news (#5846) binmakeswell 2024-06-21 14:20:45 +08:00
• 8a5c86439a [gemini] fix missing return (#5845) botbw 2024-06-21 11:38:40 +08:00
• 4c06215dce Merge pull request #5844 from wangbluo/offload Wang Binluo 2024-06-20 17:07:57 +08:00
• e893f88a4f Merge branch 'dev/zero-offload' into offload Wang Binluo 2024-06-20 17:07:24 +08:00
• d4ff644ef3 update qwen model wangbluo 2024-06-20 09:04:57 +00:00
• dba59354d7 remove vocab_size args wangbluo 2024-06-20 08:06:39 +00:00
• 35ef72bfd1 Merge pull request #5842 from wangbluo/dev/zero-offload Wang Binluo 2024-06-20 15:37:03 +08:00
• 351a1c269b [pre-commit.ci] auto fixes from pre-commit.com hooks pre-commit-ci[bot] 2024-06-20 06:50:39 +00:00
• b12e9a3275 update llama model wangbluo 2024-06-20 06:46:25 +00:00
• bd3e34fef6 [release] update version (#5833) v0.3.9 Hongxin Liu 2024-06-20 13:33:24 +08:00
• 52ea64824e remove 4d attention mask wangbluo 2024-06-19 09:28:08 +00:00
• 7b249c76e5 [Fix] Fix spec-dec Glide LlamaModel for compatibility with transformers (#5837) Yuanheng Zhao 2024-06-19 15:37:53 +08:00
• fd1dc417d8 [shardformer] Change atol in test command-r weight-check to pass pytest (#5835) Guangyao Zhang 2024-06-19 13:59:22 +08:00
• 2014cce870 [devops] Remove building on PR when edited to avoid skip issue (#5836) Guangyao Zhang 2024-06-19 13:58:05 +08:00
• 0adca5b688 [launch] Support IPv4 host initialization in launch (#5822) Kai Lv 2024-06-18 19:18:29 +08:00
• 639394b0d4 Merge pull request #5818 from GuangyaoZhang/command-r Guangyao Zhang 2024-06-18 19:01:21 +08:00
• 7f9ec599be [misc] Add dist optim to doc sidebar (#5806) Edenzzzz 2024-06-18 13:52:47 +08:00
• 4adbc36913 Merge branch 'command-r' of github.com:GuangyaoZhang/ColossalAI into command-r GuangyaoZhang 2024-06-18 03:33:02 +00:00
• d84d68601a change 'xxx if xxx else None' to 'xxx or None' GuangyaoZhang 2024-06-18 03:32:42 +00:00
• 996c65077e [pre-commit.ci] auto fixes from pre-commit.com hooks pre-commit-ci[bot] 2024-06-18 03:32:29 +00:00
• a83a2336e8 rebase master llama change GuangyaoZhang 2024-06-18 02:56:47 +00:00
• 20c0b06ff5 Merge branch 'command-r' of github.com:GuangyaoZhang/ColossalAI into command-r GuangyaoZhang 2024-06-18 02:37:14 +00:00
• 363cde6957 merge model and attention forward GuangyaoZhang 2024-06-17 08:50:05 +00:00
• 7a2b08646f Remove CohereLayerNorm and use existing layernorm GuangyaoZhang 2024-06-14 09:14:01 +00:00
• fe2e74c03a fix precommit GuangyaoZhang 2024-06-14 08:09:24 +00:00
• 98da648a4a Fix Code Factor check GuangyaoZhang 2024-06-14 08:04:29 +00:00
• f656d61778 change command GuangyaoZhang 2024-06-14 03:04:56 +00:00
• 0b81163bc0 Copy llama to command GuangyaoZhang 2024-06-13 06:47:58 +00:00
• 8795bb2e80 Support 4d parallel + flash attention (#5789) Edenzzzz 2024-06-17 17:40:47 +08:00
• 3c7302ad0e merge model and attention forward GuangyaoZhang 2024-06-17 08:50:05 +00:00
• 8c3f524660 Remove CohereLayerNorm and use existing layernorm GuangyaoZhang 2024-06-14 09:14:01 +00:00
• df612434c9 [pre-commit.ci] auto fixes from pre-commit.com hooks pre-commit-ci[bot] 2024-06-14 05:02:37 +00:00
• 4c69e2dc91 support qwen model Wang Binluo 2024-04-09 11:50:35 +08:00
• 32e642bf40 revert: enable return_outputs when necessary Wenhao Chen 2024-03-01 16:50:58 +08:00
• 856b39f69d to: add qwen2 auto policy Wenhao Chen 2024-03-01 16:55:04 +08:00
• 6fa181ebef feat: add qwen2 to model_zoo Wenhao Chen 2024-03-01 17:23:46 +08:00
• 14305c9449 test: add qwen2 shard test Wenhao Chen 2024-03-01 17:26:20 +08:00
• 5512bdf1fc fix: modify model config and add Qwen2RMSNorm Wenhao Chen 2024-03-04 11:22:34 +08:00
• 5c2a47a667 feat: support qwen2 model Wenhao Chen 2024-03-04 13:33:11 +08:00
• c9025ebd7c Merge branch 'command-r' of github.com:GuangyaoZhang/ColossalAI into command-r GuangyaoZhang 2024-06-14 08:10:31 +00:00
• 9a290ab013 fix precommit GuangyaoZhang 2024-06-14 08:09:24 +00:00
• 2a7fa2e7d0 [pre-commit.ci] auto fixes from pre-commit.com hooks pre-commit-ci[bot] 2024-06-14 08:05:06 +00:00
• 1016bb3257 Fix Code Factor check GuangyaoZhang 2024-06-14 08:04:29 +00:00
• 94fbde6055 change command GuangyaoZhang 2024-06-14 03:04:56 +00:00
• 431b7bcf8f Copy llama to command GuangyaoZhang 2024-06-13 06:47:58 +00:00
• 2ddf624a86 [shardformer] upgrade transformers to 4.39.3 (#5815) flybird11111 2024-06-14 10:59:33 +08:00
• 3bcbba9262 [gemini] quick fix on possible async operation (#5803) botbw 2024-06-13 10:35:17 +08:00
• d9dddf574f [Gemini] Use async stream to prefetch and h2d data moving (#5781) Haze188 2024-06-12 15:48:52 +08:00
• 8554585a5f [Inference] Fix flash-attn import and add model test (#5794) Li Xingjian 2024-06-12 14:13:50 +08:00
• aac941ef78 [test] fix qwen2 pytest distLarge (#5797) Guangyao Zhang 2024-06-12 12:13:51 +08:00
• aa125bcc91 [shardformer] fix modeling of bloom and falcon (#5796) Hongxin Liu 2024-06-11 17:43:50 +08:00
• 587bbf4c6d [test] fix chatglm test kit (#5793) Hongxin Liu 2024-06-11 16:54:31 +08:00
• 74f4a29734 Merge pull request #5759 from hpcaitech/colossalchat_upgrade YeAnbang 2024-06-11 12:49:53 +08:00
• c0948aff97 [Inference]refactor baichuan (#5791) Runyu Lu 2024-06-11 10:52:01 +08:00
• 84eab13078 update sft trainning script YeAnbang 2024-06-11 02:44:20 +00:00
• 77a219a082 Merge pull request #5771 from char-1ee/refactor/modeling Li Xingjian 2024-06-10 11:52:22 +08:00
• b303976a27 Fix test import char-1ee 2024-06-10 02:03:30 +00:00
• 2abdede1d7 fix readme YeAnbang 2024-06-10 01:08:42 +00:00
• f5981e808e Remove flash attention backend char-1ee 2024-06-07 10:02:19 +00:00
• 77db21610a replace the customized dataloader setup with the build-in one YeAnbang 2024-06-07 09:44:25 +00:00
• 0d7ff10ea5 replace the customized dataloader setup with the build-in one YeAnbang 2024-06-07 09:43:42 +00:00
• ceba662d22 Clean up char-1ee 2024-06-07 09:09:29 +00:00
• 5f398fc000 Pass inference model shard configs for module init char-1ee 2024-06-07 08:28:19 +00:00
• eec77e5702 Fix tests and naming char-1ee 2024-06-03 05:41:32 +00:00