You can now train a 70b language model at home – Answer.AI

www.answer.ai

cross-posted to:
hackernews@lemmy.smeargle.fans

You can now train a 70b language model at home – Answer.AI

www.answer.ai

ikidd@lemmy.worldM to

Artificial Intelligence@lemmy.worldEnglish · 1 year ago

cross-posted to:
hackernews@lemmy.smeargle.fans

We’re releasing an open source system, based on FSDP and QLoRA, that can train a 70b model on two 24GB GPUs.

You must log in or # to comment.

Chat

Artificial Intelligence@lemmy.world

ai_@lemmy.world

Create a post

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !ai_@lemmy.world

Welcome to the AI Community!

Let’s explore AI passionately, foster innovation, and learn together. Follow these guidelines for a vibrant and respectful community:

Be kind and respectful.
Share high-quality contributions.
Stay on-topic.
Enhance accessibility.
Verify information.
Encourage meaningful discussions.

You can access the AI Wiki at the following link: AI Wiki

Let’s create a thriving AI community together!

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

8 users / day
14 users / week
68 users / month
68 users / 6 months
1 local subscriber
1.94K subscribers
278 Posts
292 Comments
Modlog