Thank you @lancedb for the collaboration! You can now do world modeling research at scale, super fast, streaming data, all within stable-worldmodel! Also shoutout to stable-pretraining, the training engine behind all our papers that is scalable and research friendly!
LanceDB (@lancedb)
2/ The loader is URI-agnostic: local, s3://, gs://, hf://buckets/... all use identical code. @huggingface Buckets is first-class — Lance's fragment design and Buckets' chunk storage share deduplication primitives, so you get it for free.
— https://nitter.net/lancedb/status/2062557704569213254#m