open-sci/1.7b-Comma0.1-300BT-longsft_16k-SFT-Tulu3-decontaminated-sr30k
Feature Extraction • 2B • Updated • 27
AI & ML interests
Researching and building foundation models with improved generalization and reasoning. LAION & friends spin-off for open-sourcing foundation models with strong generalization and reasoning , including datasets necessary for their creation, to serve as common open, reproducible grounds for further research experiments.
Recent Activity
View all activity
open-sci/1.7b-Comma0.1-300BT-longsft_16k-SFT-Tulu3-decontaminated-nc30k
Feature Extraction • 2B • Updated • 28
open-sci/1.7b-Comma0.1-300BT-longsft_16k-SFT-Tulu3-decontaminated-ar30k
Feature Extraction • 2B • Updated • 27
open-sci/1.7b-Comma0.1-300BT-longsft_16k-SFT-Tulu3-decontaminated
Text Generation • 2B • Updated • 210
open-sci/1.7b-Comma0.1-300BT-longsft_16k-DPO-Tulu3-decontaminated-sr30k
Feature Extraction • 2B • Updated • 24
open-sci/1.7b-Comma0.1-300BT-longsft_16k-DPO-Tulu3-decontaminated-nc30k
Feature Extraction • 2B • Updated • 27
open-sci/1.7b-Comma0.1-300BT-longsft_16k-DPO-Tulu3-decontaminated-ar30k
Feature Extraction • 2B • Updated • 27
open-sci/open-sci-ref-v0.02-1.7b-comma-mv_reasoning-300B-4096-longsft_16k
2B • Updated • 51
open-sci/open-sci-ref-v0.02-1.7b-comma-mv_reasoning-300B-4096
2B • Updated • 4
open-sci/open-sci-ref-v0.02-1.7b-fineweb-edu-1.4t-mv_reasoning-300B-4096-longsft_16k
2B • Updated • 6
open-sci/open-sci-ref-v0.02-1.7b-nemotron-hq-mv_reasoning-300B-4096-longsft_16k
2B • Updated • 5
open-sci/open-sci-ref-v0.02-1.7b-nemotron-hq-300B-4096-longsft_16k
2B • Updated • 10
open-sci/open-sci-ref-v0.02-1.7b-mixturevitae-noinstruct-300B-4096-longsft_16k
2B • Updated • 7
open-sci/open-sci-ref-v0.02-1.7b-mixturevitae-300B-4096-longsft_16k
2B • Updated • 4
open-sci/open-sci-ref-v0.02-1.7b-fineweb-edu-1.4t-300B-4096-longsft_16k
Feature Extraction • 2B • Updated • 8 • 1
open-sci/open-sci-ref-v0.02-1.7b-fineweb-edu-1.4t-300B-4096
2B • Updated • 9
open-sci/open-sci-ref-v0.02-1.7b-nemotron-hq-300B-4096
2B • Updated • 7
open-sci/open-sci-ref-v0.02-1.7b-mixturevitae-300B-4096
2B • Updated • 12
open-sci/open-sci-ref-v0.02-1.7b-fineweb-edu-1.4t-mv_reasoning-300B-4096
2B • Updated • 13
open-sci/open-sci-ref-v0.02-1.7b-nemotron-hq-mv_reasoning-300B-4096
2B • Updated • 8
open-sci/open-sci-ref-v0.02-1.7b-mixturevitae-noinstruct-300B-4096
2B • Updated • 8
open-sci/open-sci-ref-v0.02-1.7b-nemotron-hq-100B-8192
2B • Updated • 5
open-sci/open-sci-ref-v0.02-1.7b-nemotron-hq-1T-4096
2B • Updated • 7
open-sci/open-sci-ref-v0.02-1.7b-dclm-1T-4096
2B • Updated • 5
open-sci/open-sci-ref-v0.02-1.7b-fineweb-edu-1.4t-1T-4096
2B • Updated • 6
open-sci/open-sci-ref-v0.02-1.7b-commoncorpus-300B-4096
2B • Updated • 4
open-sci/open-sci-ref-v0.02-1.3b-commoncorpus-300B-4096
1B • Updated • 8
open-sci/open-sci-ref-v0.02-1.7b-dclm-1T-4096-rope_theta-100k
Text Generation • 2B • Updated • 29
open-sci/open-sci-ref-v0.02-1.7b-fineweb-edu-1.4t-1T-4096-rope_theta-100k
Text Generation • 2B • Updated • 24
open-sci/open-sci-ref-v0.02-1.7b-nemotron-hq-1T-4096-rope_theta-100k
Text Generation • 2B • Updated • 42