| # microsoft/codebert-base Script Detector |
|
|
| ## Summary |
|
|
| | Field | Value | |
| | --- | --- | |
| | Base model | `microsoft/codebert-base` | |
| | Phase | `phase1` | |
| | Target repo | `HID-APP/script-detector-microsoft-codebert-base` | |
| | Datasets | `HID-APP/All-combined` | |
| | Text column | `text` | |
| | Epochs | 9.0000 | |
| | Max length | 512 | |
| | Train batch size | 4 | |
| | Eval batch size | 8 | |
| | Gradient accumulation steps | 4 | |
| | Learning rate | 0.0000 | |
| | Precision | fp16 | |
| | Optimizer | adamw_torch | |
| | Dataloader workers | 0 | |
| | Gradient checkpointing | False | |
| | Group by length | True | |
| | LoRA enabled | False | |
| |
| ## Dataset Sources |
| |
| | Source | Type | Revision | Fingerprint | |
| | --- | --- | --- | --- | |
| | HID-APP/All-combined | huggingface | default | 81f16d3fdbb4f97d3574f5c78bce8ada7b15c9ccd625913daa095cae6d545d67 | |
| |
| ## Training And Validation History |
| |
| | Epoch | Step | Train Loss | Eval Loss | Accuracy | Precision | Recall | F1 | |
| | --- | --- | --- | --- | --- | --- | --- | --- | |
| | 1.0000 | 373 | 3.2531 | | | | | | |
| | 1.0000 | 373 | | 0.5277 | 0.8353 | 0.8144 | 0.9806 | 0.8898 | |
| | 2.0000 | 746 | 2.7352 | | | | | | |
| | 2.0000 | 746 | | 0.5214 | 0.8291 | 0.8015 | 0.9943 | 0.8875 | |
| | 3.0000 | 1119 | 2.6190 | | | | | | |
| | 3.0000 | 1119 | | 0.5194 | 0.8360 | 0.8383 | 0.9396 | 0.8860 | |
| | 4.0000 | 1492 | 2.6431 | | | | | | |
| | 4.0000 | 1492 | | 0.5421 | 0.8283 | 0.7985 | 0.9989 | 0.8875 | |
| | 5.0000 | 1865 | 2.5547 | | | | | | |
| | 5.0000 | 1865 | | 0.5425 | 0.8268 | 0.8026 | 0.9875 | 0.8855 | |
| | 6.0000 | 2238 | 2.5015 | | | | | | |
| | 6.0000 | 2238 | | 0.5806 | 0.8291 | 0.8048 | 0.9875 | 0.8868 | |
| | 7.0000 | 2611 | 2.4438 | | | | | | |
| | 7.0000 | 2611 | | 0.6349 | 0.8515 | 0.9442 | 0.8301 | 0.8835 | |
| | 8.0000 | 2984 | 2.4136 | | | | | | |
| | 8.0000 | 2984 | | 0.6463 | 0.8484 | 0.9097 | 0.8620 | 0.8852 | |
| |
