Detection Decay in Multi-Tenant SIEM: Measuring Rule Half-Life and a Decay-Aware Content Lifecycle Model
DOI:
https://doi.org/10.63282/3050-9262.IJAIDSML-V6I2P130Keywords:
Detection Engineering, SIEM, Survival Analysis, Rule Half-Life, MITRE ATT&CK, Schema Drift, Security OperationsAbstract
Enterprise SIEM detection content is authored once and audited rarely, yet its efficacy degrades continuously as log schemas drift, business processes change, and adversaries adapt. Existing detection-engineering practice treats coverage as a static ATT&CK matrix property and schedules rule review on fixed calendars, implicitly assuming efficacy is time-invariant. This paper introduces detection decay as a measurable property of deployed correlation logic. We define rule half-life as the elapsed operational time at which a detection's true-positive yield falls to half its post-tuning baseline, and estimate it using Cox proportional-hazards survival analysis with time-varying covariates over 24 months of alert-disposition telemetry from a multi-tenant managed-SIEM estate (11 tenants, 1,847 deployed detections, 2.1M dispositions) spanning Splunk Enterprise Security and Microsoft Sentinel. Covariates - schema-change events, ingestion-volume shift, field-conformance failure rate, and tuning interventions - are extracted automatically from CIM/ASIM conformance telemetry and index-time parsing errors, yielding a per-rule hazard score computable inside the SIEM itself. Results show decay is neither uniform nor primarily adversary-driven: schema and telemetry-source instability account for 61% of hazard in credential-access and persistence detections, whereas defence-evasion logic decays fastest under adversary pressure (median half-life 94 days versus term-wide 211). We then propose a decay-aware lifecycle governance model that replaces calendar-based review with hazard-triggered revalidation under a bounded budget. Against a fixed-interval baseline it retains 87.4% detection efficacy versus 68.1% (p < 0.001), reduces analyst-hours per true positive by 34.2%, and lowers false-positive volume by 30.6% at equal reviewer headcount.
References
[1] Bhatt, S., Manadhata, P. K., & Zomlot, L. (2018). The operational role of security information and event management systems. IEEE Security & Privacy, 16(5), 35–41.
[2] Chen, Y., Zhang, Y., & Liu, X. (2020). Concept drift detection in streaming security analytics. Computers & Security, 95, 101869.
[3] Sandeep Kamadi. (2022). Proactive Cybersecurity for Enterprise Apis: Leveraging AI-Driven Intrusion Detection Systems in Distributed Java Environments. International Journal of Research in Computer Applications and Information Technology (IJRCAIT), 5(1), 34-52. https://iaeme.com/MasterAdmin/Journal_uploads/IJRCAIT/VOLUME_5_ISSUE_1/IJRCAIT_05_01_004.pdfCinque, M., Cotroneo, D., & Pecchia, A. (2018). Challenges and directions in security information and event management. Proceedings of the IEEE International Symposium on Software Reliability Engineering Workshops, 95–99.
[4] Feng, C., Wu, S., & Liu, N. (2017). A user-centric machine learning framework for cyber security operations centers. Proceedings of the IEEE International Conference on Intelligence and Security Informatics, 173–175.
[5] Sivaramakrishnan Narayanan (2022). Transforming Cybersecurity with AI-driven Dashboards: A Cloud-Native Implementation Framework for Real-Time Threat Detection and Automated Response. International Journal of Future Innovative Science and Technology (IJFIST) , Vol. 5 No. 5 (2022): International Journal of Future Innovative Science and Technology (IJFIST) , pp. 9207-9217. https://doi.org/10.15662/IJFIST.2022.0505004
[6] Hassan, W. U., Guo, S., Li, D., Chen, Z., Jee, K., Li, Z., & Bates, A. (2019). NoDoze: Combatting threat alert fatigue with automated provenance triage. Proceedings of the Network and Distributed System Security Symposium.
[7] Lakshmi Kiran Meesala "AI-Driven Cyber Defense: A Hybrid Deep Learning Framework for Real-Time Threat Prediction and Response" International Journal of Scientific Research in Science, Engineering and Technology (IJSRSET), Print ISSN : 2395-1990, Online ISSN : 2394-4099, Volume 10, Issue 2, pp.916-930, March-April-2023. Available at doi : https://doi.org/10.32628/IJSRSET235845
[8] Kotenko, I., & Chechulin, A. (2017). Analytical modeling and assessment of security event correlation. Journal of Computer Virology and Hacking Techniques, 13(3), 187–199.
[9] Kwon, D., Kim, H., Kim, J., Suh, S. C., Kim, I., & Kim, K. J. (2019). A survey of deep learning-based network anomaly detection. Cluster Computing, 22, 949–961.
[10] Legoy, V., Caselli, M., Seifert, C., & Peter, A. (2020). Automated retrieval of ATT&CK tactics and techniques for cyber threat reports. arXiv preprint arXiv:2004.14322.
[11] Nadeem, A., Verwer, S., Moskal, S., & Yang, S. J. (2021). Alert-driven attack graph generation using S-PDFA. IEEE Transactions on Dependable and Secure Computing, 19(2), 731–746.
[12] Sandeep Kamadi, " Risk Exception Management in Multi-Regulatory Environments: A Framework for Financial Services Utilizing Multi-Cloud Technologies" International Journal of Scientific Research in Computer Science, Engineering and Information Technology (IJSRCSEIT), ISSN : 2456-3307, Volume 7, Issue 5, pp.350-361, September-October-2021. Available at doi : https://doi.org/10.32628/CSEIT217560
[13] Oprea, A., Li, Z., Norris, R., & Bowers, K. (2018). MADE: Security analytics for enterprise threat detection. Proceedings of the Annual Computer Security Applications Conference, 124–136.
[14] Meesala, A. (2022). Adaptive Spread Anomaly Intelligence Framework (ASAIF): A cloud-native AI framework for real-time bid-ask spread anomaly detection and cross-venue liquidity risk intelligence. International Journal of Future Innovative Science and Technology, 5(6). https://doi.org/10.15662/IJFIST.2022.0506007
[15] Rahman, M. R., Mahdavi-Hezaveh, R., & Williams, L. (2020). A literature review on mining cyberthreat intelligence from unstructured texts. Proceedings of the IEEE International Conference on Data Mining Workshops, 516–525.
[16] Sivaramakrishnan Narayanan (2023). Operationalizing Artificial Intelligence Security in the Cloud: A Practical Integration framework for Enterprise Risk Management. International Journal of Future Innovative Science and Technology (IJFIST) , Vol. 6 No. 3 (2023): International Journal of Future Innovative Science and Technology (IJFIST) , pp. 10611-10619. https://doi.org/10.15662/IJFIST.2023.0603002
[17] Strom, B. E., Applebaum, A., Miller, D. P., Nickels, K. C., Pennington, A. G., & Thomas, C. B. (2018). MITRE ATT&CK: Design and philosophy. MITRE Corporation.
[18] Vielberth, M., Böhm, F., Fichtinger, I., & Pernul, G. (2020). Security operations center: A systematic study and open challenges. IEEE Access, 8, 227756–227779.
[19] Sandeep Kamadi, " Adaptive Federated Data Science & MLOps Architecture: A Comprehensive Framework for Distributed Machine Learning Systems" International Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 8, Issue 6, pp.745-755, November-December-2022. Available at doi : https://doi.org/10.32628/CSEIT22555
[20] Wagner, T. D., Mahbub, K., Palomar, E., & Abdallah, A. E. (2019). Cyber threat intelligence sharing: Survey and research directions. Computers & Security, 87, 101589.
[21] Lakshmi Kiran Meesala, " Modern Security Information and Event Management: Architecture, Analytics Pipelines, and Empirical Evaluation of SOC-Scale Threat Detection" International Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 9, Issue 4, pp.995-1012, July-August-2023. Available at doi : https://doi.org/10.32628/CSEIT23564538
[22] Zimmermann, M., Gerhardt, A., & Kaiser, D. (2021). Reliability-centred maintenance scheduling using proportional hazards modelling. Reliability Engineering & System Safety, 209, 107470.
[23] Arun Meesala , " A Distributed Kafka-Centric Framework for High-Throughput Mid-Price Computation and Intelligent Time-Series Persistence in Financial Clouds" International Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 9, Issue 2, pp.998-1006, March-April-2023. Available at doi : https://doi.org/10.32628/CSEIT2342442.










