Kodesha GPU ya NVIDIA GTX TITAN X ifite 12 GB VRAM
Kodesha seriveri za GPU zo mu gicu za GTX TITAN X ku isaha kuri Cloudj: VRAM ya 12 GB kuri NVIDIA Maxwell ifite hafi 6.8 TFLOPS FP32 n'umuvuduko wa bandwidth wa 239 GB/s. Ni yo karita ishaje kurusha izindi ku rutonde rwacu, ifasha cyane kuri kode za kera za CUDA, igerageza rya FP32 n'ibizamini by'ububiko bwa memori bwa 12 GB aho ibiranga bigezweho bidakenewe (150 W, compute capability 5.2). Banza usuzume niba bihuye na template yawe, hanyuma wihuze ukoresheje SSH.
Ibiranga GTX TITAN X
VRAM kuri buri GPU
12 GB
Ubwubatsi
NVIDIA Maxwell
Ubushobozi bwo kubara
5.2
Imibare ya FP32
≈ 6.8 TFLOPS
Umuvuduko w'ububiko (Bandwidth)
≈ 239 GB/s
Ingufu ntarengwa
150 W
Imibare yatanzwe n'uwatanze seriveri ku mashini ziriho ubu; imikorere nyakuri iratandukana bitewe na mashini.
Imiterere n'ibiciro bya GTX TITAN X bihari ako kanya
Ibihari n'ibiciro bihora bivugururwa. Igiciro cya nyuma cyemezwa mbere yo gutumiza.
Kodesha ubuIbyo ushobora gukorera kuri GTX TITAN X cloud GPU
Koresha CUDA ya kera na kode z'ubushakashatsi
Koresha porogaramu zishaje zakorewe Maxwell cyangwa ibikoresho bya mbere bya CUDA utabanje kubihindura.
Igerageza rya memori ya 12 GB
Suzuma niba ikusanyirizo ry'amakuru cyangwa moderi bikwirwa muri 12 GB mbere yo kwimukira kuri karita yihuta kurushaho.
Moderi za 7B zoroheje (quantized)
Koresha moderi za 7B GGUF kuri 4-bit mu bikoresho bishingiye kuri llama.cpp aho verisiyo yakozwe ishyigikira Maxwell.
Imirimo yo kubara ya FP32
Gukora ibyiciro by'igereranya rya mudasobwa na kode z'imibare zikenera gusa FP32 isanzwe.
Ese GTX TITAN X niyo GPU ikwiriye imirimo yawe?
Hitamo GTX TITAN X niba ukeneye VRAM ya 12 GB yo gukora iterambere rya software, guhuza na porogaramu za kera, cyangwa inference yoroshye utiriwe wishyurira amoko mashya y'ibikoresho. Hitamo GPU nto niba umutwaro w'akazi kawe ukoresha memori nkeya, cyangwa uzamure ukoreshe GPU nshya kandi nini niba ukeneye ubushobozi bugezweho bwo kubara n'umuvuduko munini wa memori wo gutoza imishinga minini.
GTX TITAN X ugereranyije n'izindi cloud GPU zisa nayo
| GPU | VRAM kuri buri GPU | Imibare ya FP32 | Ingufu ntarengwa | |
|---|---|---|---|---|
| NVIDIA GTX TITAN X | 12 GB | ≈ 6.8 TFLOPS | 150 W | |
| NVIDIA Titan Xp | 12 GB | ≈ 11.7 TFLOPS | 160 W | Ibisobanuro → |
| NVIDIA GTX 1080 Ti | 11 GB | ≈ 11 TFLOPS | 250 W | Ibisobanuro → |
| NVIDIA RTX 2080 Ti | 11 GB | ≈ 14.6 TFLOPS | 250 W | Ibisobanuro → |
| NVIDIA GTX 1070 Ti | 8 GB | ≈ 7.4 TFLOPS | 180 W | Ibisobanuro → |
GTX TITAN X cloud GPU: Ibibazo bikunze kubazwa
Kodesha GTX TITAN X cloud GPU ku isaha
Hitamo template, hitamo imiterere ihari maze wihuze ukoresheje SSH cyangwa terminal ya browser. Kwishyuza bihagarara iyo usibye iyo GPU.