Deploy Llama 3x8b
Hi all,
Is it possible to deploy llama 3x8b on this type of server :
PowerEdge T360 Server
Smart Selection PowerEdge T360
Trusted Platform Module 2.0 V3
3.5" Chassis with up to 8 Hot Plug Hard Drives and AIC PERC 11, hot-plug PSU
Intel® Xeon® E-2478 2.8G, 8C/16T, 24M Cache, Turbo, HT (80W) DDR5-4800
Heatsink for 80W or less CPU
Performance Optimized
4800MT/s UDIMMs
16GB UDIMM, 4800MT/s ECC
C7, Unconfigured RAID for HDDs or SSDs (Mixed Drive Types Allowed)
PERC H755 Adapter FH
600GB Hard Drive SAS ISE 12Gbps 10k 512n 2.5in with 3.5in HYB CARR Hot-Plug
Power Saving BIOS Setting
No Energy Star
UEFI BIOS Boot Mode with GPT Partition
Performance Fan(required for GPU/10G NIC/BOSS),acoustic level not recommended for typical office use
iDRAC9, Enterprise 16G
Dual, Hot-Plug, Power Supply, 700W MM HLAC (ONLY FOR 200-240Vac) Titanium, Redundant (1+1)
European Power Cord 220V
PowerEdge T360 Motherboard with Broadcom 5720 Dual Port 1Gb On-Board LOM
iDRAC,Factory Generated Password, No OMQR
iDRAC Service Module (ISM), NOT Installed
Security Bezel
iDRAC Group Manager, Disabled
BOSS-N1 controller card + with 2 M.2 480GB (RAID 1)
No Operating System
No Media Required
No Systems Documentation, No OpenManage DVD Kit
PowerEdge T360 Shipping EMEA1 (English/French/German/Spanish/Russian/Hebrew)
PowerEdge T350 and T360 Shipping Material
PowerEdge T360 CE and CCC Marking, No BIS Marking
Titanium PSU configuration
No Internal Optical Drive
ProSupport and Next Business Day Onsite Service, 36 Month(s)
Thanks for your answer