Ese CMP 170HX irakwiriye mu gutosa za model (training)?

Iberanye cyane no gukora inference n'imirimo ikenera umuvuduko w'ububiko. Kubera ifite 12.1 TFLOPS FP32, igenda gahoro mu gutosa model zikenera compute nyinshi ugereranyije n'amakarita nka A40 cyangwa RTX 3090, bityo banza ugerageze akazi kawe mbere yo gutegura igihe kirekire.

Kuki ngomba kubanza kugerageza akazi kanjye?

CMP 170HX ni ikarita yagenewe compute gusa, kandi amwe mu masomero na porogaramu ashobora gukora mu buryo butandukanye n'uko akora kuri za GPU zisanzwe. Igerageza rigufi ry'isaha rimwe rigufasha kumenya niba framework yawe, drivers na model bikora nk'uko ubyiteze.

Ni ikihe kintu gikomeye kurusha ibindi kuri tekiniki za CMP 170HX?

Umuvuduko w'ububiko (memory bandwidth): ugera kuri 1516 GB/s, uruta 1313 GB/s ibarirwa kuri A100 PCIE, ibyo bikaba bifasha akazi kose gakenera ububiko cyane kurusha imibare y'ubushobozi bwa mudasobwa.

Ngomba kugumana seriveri ya CMP 170HX igihe kingana iki kuri Cloudj?

Igihe cyose ubikeneye. Kwishyuza ku isaha bikwishyuza ku isaha igihe cyose seriveri igikora, kandi ushobora kuyisiba ako kanya akazi cyangwa igerageza rirangiye.

GPU Cloud · NVIDIA · Ampere

Kodesha GPU ya NVIDIA CMP 170HX ifite 64 GB VRAM

Kodesha seriveri za GPU cloud zo mu bwoko bwa CMP 170HX ku isaha kuri Cloudj: ifite VRAM ya 64 GB, yubakiye kuri tekinoloji ya Ampere kandi ifite umuvuduko w'ububiko (memory bandwidth) ugera kuri 1516 GB/s ku mirimo ikenera ububiko bwihuse. Ni ikarita ya compute idafite ibyo kwerekana amashusho (headless) igenewe abakora porogaramu bitaho cyane umuvuduko n'ubushobozi bw'ububiko kurusha umuvuduko wa FP32 (12.1 TFLOPS, 250 W, compute capability 8.0). Banza ukore igerageza rigufi kuri template ya PyTorch cyangwa Ollama, hanyuma wongere ubushobozi bw'akazi kawe.

Kodesha CMP 170HX GPU zose

Ibiranga CMP 170HX

VRAM kuri buri GPU

64 GB

Ubwubatsi

NVIDIA Ampere

Ubushobozi bwo kubara

Imibare ya FP32

≈ 12.1 TFLOPS

Umuvuduko w'ububiko (Bandwidth)

≈ 1516 GB/s

Ingufu ntarengwa

250 W

Imibare yatanzwe n'uwatanze seriveri ku mashini ziriho ubu; imikorere nyakuri iratandukana bitewe na mashini.

Imiterere n'ibiciro bya CMP 170HX bihari ako kanya

Ibihari n'ibiciro bihora bivugururwa. Igiciro cya nyuma cyemezwa mbere yo gutumiza.

Kodesha ubu

Ibyo ushobora gukorera kuri CMP 170HX cloud GPU

Inference ikenera memory bandwidth ihambaye

Gukora ama-tokens ya LLM bibangamirwa ahanini n'umuvuduko w'ububiko (memory bandwidth), kandi 1516 GB/s iri mu rwego rumwe n'amakarita yo mu cyiciro cya A100.

Gucumbikira ama-LLM ya quantized

Injiza za model za quantized muri Ollama cyangwa llama.cpp maze uzitange binyuze kuri API yo gukora igerageza cyangwa ibikoresho by'imbere mu kigo.

Igerageza rya CUDA kernels

Suzuma imikorere ya za kernel zikoresha ububiko bwinshi ku ikarita ya Ampere ifite compute capability 8.0 mbere yo kuzimurira ku byuma binini kurushaho.

Gutunganya amakuru menshi icyarimwe (Batch processing)

Cisha amatsinda manini y'amakuru (large arrays) mu bubiko bwa GPU ku mirimo ya transforms, hashing cyangwa isesengura ry'amakuru (analytics) rishingiye ku kwihuta k'ububiko.

Ese CMP 170HX niyo GPU ikwiriye imirimo yawe?

Hitamo CMP 170HX igihe akazi kawe kabangamirwa n'ubushobozi hamwe n'umuvuduko w'ububiko aho kuba ubushobozi bwa compute ya single-precision. Hitamo GPU ifite ubushobozi bwisumbuyeho bwa compute niba ukeneye kwihutisha itozwa rya za model (training iterations), cyangwa uhitemo ikarita isanzwe y'abaguzi niba za model zawe zidakeneye VRAM ingana na 64 GB.

CMP 170HX ugereranyije n'izindi cloud GPU zisa nayo

GPU	VRAM kuri buri GPU	Imibare ya FP32	Ingufu ntarengwa
NVIDIA CMP 170HX	64 GB	≈ 12.1 TFLOPS	250 W
NVIDIA A800 PCIE	80 GB	≈ 15.6 TFLOPS	300 W	Ibisobanuro →
NVIDIA H100 PCIE	80 GB	≈ 41 TFLOPS	350 W	Ibisobanuro →
NVIDIA H100 SXM	80 GB	≈ 53.5 TFLOPS	700 W	Ibisobanuro →
NVIDIA A40	45 GB	≈ 29.9 TFLOPS	300 W	Ibisobanuro →

CMP 170HX cloud GPU: Ibibazo bikunze kubazwa

Kodesha CMP 170HX cloud GPU ku isaha

Hitamo template, hitamo imiterere ihari maze wihuze ukoresheje SSH cyangwa terminal ya browser. Kwishyuza bihagarara iyo usibye iyo GPU.

Kodesha CMP 170HX GPU zose