AI/ML Model Evaluation Results
================================
Method: stratified 70/30 hold-out plus 5-fold validation.
Leakage control: status_code, authorization_result, scenario, anomaly_score and labels are excluded from model inputs.
Features: query_depth, query_complexity, response_time_ms, target_drone_id, target_mission_id, role, operation_type, operation_name
Additional artifacts: model_explainability.csv and unseen_attack_evaluation.csv.

Model: decision_tree
Accuracy: 1.0
Precision: 1.0
Recall: 1.0
F1-score: 1.0
False positive rate: 0.0
False negative rate: 0.0
ROC-AUC: 1.0
5-fold CV F1: 0.9943 (+/- 0.0114)
Confusion matrix TN/FP/FN/TP: 63/0/0/27
Feature importance: response_time_ms:0.955, query_complexity:0.045, query_depth:0.000, target_drone_id:0.000, target_mission_id:0.000, role_ADMIN:0.000, role_ANONYMOUS:0.000, role_OPERATOR:0.000
Model file: models\decision_tree.joblib
Predictions: outputs\decision_tree_test_predictions.csv

Model: random_forest
Accuracy: 1.0
Precision: 1.0
Recall: 1.0
F1-score: 1.0
False positive rate: 0.0
False negative rate: 0.0
ROC-AUC: 1.0
5-fold CV F1: 0.9943 (+/- 0.0114)
Confusion matrix TN/FP/FN/TP: 63/0/0/27
Feature importance: response_time_ms:0.349, target_drone_id:0.171, query_complexity:0.128, role_OPERATOR:0.108, query_depth:0.043, role_VIEWER:0.028, target_mission_id:0.020, operation_name_ALLTELEMETRY:0.019
Model file: models\random_forest.joblib
Predictions: outputs\random_forest_test_predictions.csv

Model: logistic_regression
Accuracy: 1.0
Precision: 1.0
Recall: 1.0
F1-score: 1.0
False positive rate: 0.0
False negative rate: 0.0
ROC-AUC: 1.0
5-fold CV F1: 1.0 (+/- 0.0)
Confusion matrix TN/FP/FN/TP: 63/0/0/27
Feature importance: response_time_ms:1.779, target_drone_id:1.734, role_OPERATOR:1.291, query_complexity:0.942, operation_name_TELEMETRY:0.877, role_VIEWER:0.850, role_UNKNOWN:0.728, operation_name_LOGIN:0.728
Model file: models\logistic_regression.joblib
Predictions: outputs\logistic_regression_test_predictions.csv

Model: extra_trees
Accuracy: 1.0
Precision: 1.0
Recall: 1.0
F1-score: 1.0
False positive rate: 0.0
False negative rate: 0.0
ROC-AUC: 1.0
5-fold CV F1: 1.0 (+/- 0.0)
Confusion matrix TN/FP/FN/TP: 63/0/0/27
Feature importance: response_time_ms:0.178, target_drone_id:0.178, role_OPERATOR:0.152, query_complexity:0.097, role_VIEWER:0.054, operation_name_TELEMETRY:0.043, role_ANONYMOUS:0.036, operation_name_ALLTELEMETRY:0.029
Model file: models\extra_trees.joblib
Predictions: outputs\extra_trees_test_predictions.csv

Model: isolation_forest
Accuracy: 0.3444
Precision: 0.314
Recall: 1.0
F1-score: 0.4779
False positive rate: 0.9365
False negative rate: 0.0
ROC-AUC: 0.9148
5-fold CV F1: 0.4852 (+/- 0.0049)
Confusion matrix TN/FP/FN/TP: 4/59/0/27
Feature importance: Not available for unsupervised Isolation Forest
Model file: models\isolation_forest.joblib
Predictions: outputs\isolation_forest_test_predictions.csv
