BlenderCartel-SCE-llama33-70B

This is a merge of pre-trained language models created using mergekitty.

Merge Details

Merge Method

This model was merged using the SCE merge method using deepcogito/cogito-v2-preview-llama-70B as a base.

Models Merged

The following models were included in the merge:

• KaraKaraWitch/BlenderCartel-llama33-70B-Pt2
• KaraKaraWitch/BlenderCartel-llama33-70B-Pt1

Configuration

The following YAML configuration was used to produce this model:

models:
  # Part 1
  - model: KaraKaraWitch/BlenderCartel-llama33-70B-Pt1
  # Part 2
  - model: KaraKaraWitch/BlenderCartel-llama33-70B-Pt2

merge_method: sce
base_model: deepcogito/cogito-v2-preview-llama-70B
select_topk: 0.8
parameters:
  normalize: true
dtype: bfloat16