Skip to Content.
Sympa Menu

phys-npps-members-l - Re: [[Phys-npps-members-l] ] DeepSeek R1 is now available on Azure AI Foundry and GitHub

phys-npps-members-l AT lists.bnl.gov

Subject: ALL NPPS Members

List archive

Chronological Thread  
  • From: Brett Viren <bv AT bnl.gov>
  • To: "Ye, Shuwei" <yesw AT bnl.gov>
  • Cc: Phys-npps-members-l AT lists.bnl.gov
  • Subject: Re: [[Phys-npps-members-l] ] DeepSeek R1 is now available on Azure AI Foundry and GitHub
  • Date: Thu, 30 Jan 2025 08:09:40 -0500

Hi,

The 32B distillation served by ollama fits on RTX 4090.


$ ollama run deepseek-r1:32b
...
>>> Who are you?
<think>

</think>

Greetings! I'm DeepSeek-R1, an artificial intelligence assistant created
by DeepSeek. I'm at your service and would be delighted to assist you
with any inquiries or tasks you may have.

>>> Send a message (/? for help)


$ nvidia-smi
...
ollama_llama_server 21678MiB
...

-Brett.

Attachment: signature.asc
Description: PGP signature




Archive powered by MHonArc 2.6.24.

Top of Page