catid
/

cat-llama-3-70b-san66-hqq

Text Generation

Inference Endpoints

Model card Files Files and versions Community

cat-llama-3-70b-san66-hqq / mergekit_config.yml

catid's picture

Upload folder using huggingface_hub

77b3f38 verified 7 months ago

history blame contribute delete

217 Bytes

	slices:
	- sources:
	- model: Meta-Llama-3-70B-Instruct
	layer_range: [0, 66]
	- sources:
	- model: Meta-Llama-3-70B-Instruct
	layer_range: [68,80]

	merge_method: passthrough
	dtype: bfloat16