GitHub - mainlp/steereval

INCLINE but for metrics

python intervention_comet.py

Args: "model", "dimension", "data", "prompting_lang", "gpu_id" "metric" "--layers"

python intervention_gptscore.py bigscience/bloomz-7b1-mt coherence ncwm_old tgt 0 accuracy --layers 0 1 2 3

Name		Name	Last commit message	Last commit date
README.md		README.md
constants.py		constants.py
eval_basse_avgvec_gptscore.py		eval_basse_avgvec_gptscore.py
eval_basse_gptscore.py		eval_basse_gptscore.py
eval_hitz_summarization_es.py		eval_hitz_summarization_es.py
eval_ngrams_avgvec_gptscore.py		eval_ngrams_avgvec_gptscore.py
eval_seahorse_avgvec_comet.py		eval_seahorse_avgvec_comet.py
eval_seahorse_avgvec_gptscore.py		eval_seahorse_avgvec_gptscore.py
eval_seahorse_comet.py		eval_seahorse_comet.py
eval_seahorse_geval.py		eval_seahorse_geval.py
eval_seahorse_gptscore.py		eval_seahorse_gptscore.py
intervention_comet.py		intervention_comet.py
intervention_geval.py		intervention_geval.py
intervention_gptscore.py		intervention_gptscore.py
load_basse.py		load_basse.py
load_dataset.py		load_dataset.py
load_ngrams.py		load_ngrams.py
load_seahorse.py		load_seahorse.py
map_utils.py		map_utils.py
model_and_tok.py		model_and_tok.py
plot_umap_seahorse.py		plot_umap_seahorse.py
plot_vector_similarity.py		plot_vector_similarity.py
rescore_seahorse.py		rescore_seahorse.py
run_aya32b_seahorse_avgvec.sh		run_aya32b_seahorse_avgvec.sh
run_aya_basse.sh		run_aya_basse.sh
run_aya_basse_avgvec.sh		run_aya_basse_avgvec.sh
run_aya_ngrams_avgvec.sh		run_aya_ngrams_avgvec.sh
run_aya_seahorse.sh		run_aya_seahorse.sh
run_aya_seahorse_avgvec.sh		run_aya_seahorse_avgvec.sh
run_aya_seahorse_geval.sh		run_aya_seahorse_geval.sh
run_llama3b_basse.sh		run_llama3b_basse.sh
run_llama3b_basse_avgvec.sh		run_llama3b_basse_avgvec.sh
run_llama3b_ngrams_avgvec.sh		run_llama3b_ngrams_avgvec.sh
run_llama3b_seahorse.sh		run_llama3b_seahorse.sh
run_llama3b_seahorse_avgvec.sh		run_llama3b_seahorse_avgvec.sh
run_llama3b_seahorse_geval.sh		run_llama3b_seahorse_geval.sh
run_llama8b_seahorse_avgvec.sh		run_llama8b_seahorse_avgvec.sh
run_seahorse_comet.sh		run_seahorse_comet.sh
run_seahorse_en_baseline.sh		run_seahorse_en_baseline.sh
summarize_seahorse_comet.py		summarize_seahorse_comet.py
summarize_seahorse_hyperparams.py		summarize_seahorse_hyperparams.py
summarize_seahorse_llm.py		summarize_seahorse_llm.py
summarize_seahorse_per_dim.py		summarize_seahorse_per_dim.py
ttest_seahorse.py		ttest_seahorse.py
utils.py		utils.py
vector_utils.py		vector_utils.py

Navigation Menu

Repository navigation

About

Repository files navigation

INCLINE but for metrics

About

Releases

Packages

Contributors

Languages

Latest commit

History

Folders and files

Repository files navigation

INCLINE but for metrics

About

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages