colda.algorithm.test_stage package

Submodules

colda.algorithm.test_stage.api module

class colda.algorithm.test_stage.api.MakeEval

Bases: BaseAlgorithm

Test model using the test dataset. Evaluate the predicted results at each round.

Methods

make_eval

classmethod make_eval(user_id: str, test_id: str, max_round: str, dataset_path: str, target_idx: str, skip_header: str, task_mode: Literal['classification', 'regression'], metric_name: Literal['MAD', 'RMSE', 'R2', 'Accuracy', 'F1', 'AUCROC'], sponsor_test_cooperative_model_output_every_round: dict[str, Any], assistor_test_cooperative_model_output_every_round: dict[str, Any], trained_result_rounds_0: Any, trained_alpha_every_round: dict[str, Any], matched_identifier: dict[str, Any], role: Literal['sponsor', 'assistor']) → tuple[dict]

class colda.algorithm.test_stage.api.MakeTest

Bases: BaseAlgorithm

Sponsor side:

Utilize sponsor_trained_model at each round to produce n(round number) predictions

Assistor side:

Utilize assistor_trained_model at each round to produce n(round number) predictions

Methods

make_test

classmethod make_test(user_id: str, test_id: str, max_round: int, matched_identifier: dict[str], trained_models_of_each_round: dict[str, Any], dataset_path: str, data_idx: str, skip_header: int, role: Literal['sponsor', 'assistor']) → dict[str, Any]

class colda.algorithm.test_stage.api.MakeTestLocal

Bases: BaseAlgorithm

Test locally trained model

Attributes

None

Methods

make_test_local

classmethod make_test_local(root, self_id, task_id, test_id, dataset_path, data_idx, target_idx, skip_header, task_mode, metric_name) → int | float

colda.algorithm.test_stage.make_eval module

class colda.algorithm.test_stage.make_eval.MakeEval

Bases: BaseAlgorithm

Test model using the test dataset. Evaluate the predicted results at each round.

Methods

make_eval

classmethod make_eval(user_id: str, test_id: str, max_round: str, dataset_path: str, target_idx: str, skip_header: str, task_mode: Literal['classification', 'regression'], metric_name: Literal['MAD', 'RMSE', 'R2', 'Accuracy', 'F1', 'AUCROC'], sponsor_test_cooperative_model_output_every_round: dict[str, Any], assistor_test_cooperative_model_output_every_round: dict[str, Any], trained_result_rounds_0: Any, trained_alpha_every_round: dict[str, Any], matched_identifier: dict[str, Any], role: Literal['sponsor', 'assistor']) → tuple[dict]

colda.algorithm.test_stage.make_test module

class colda.algorithm.test_stage.make_test.MakeTest

Bases: BaseAlgorithm

Sponsor side:

Utilize sponsor_trained_model at each round to produce n(round number) predictions

Assistor side:

Utilize assistor_trained_model at each round to produce n(round number) predictions

Methods

make_test

classmethod make_test(user_id: str, test_id: str, max_round: int, matched_identifier: dict[str], trained_models_of_each_round: dict[str, Any], dataset_path: str, data_idx: str, skip_header: int, role: Literal['sponsor', 'assistor']) → dict[str, Any]

colda.algorithm.test_stage.make_test_local module

class colda.algorithm.test_stage.make_test_local.MakeTestLocal

Bases: BaseAlgorithm

Test locally trained model

Attributes

None

Methods

make_test_local

classmethod make_test_local(root, self_id, task_id, test_id, dataset_path, data_idx, target_idx, skip_header, task_mode, metric_name) → int | float

Module contents