Improve error handling and reporting for automated test systems

This project is available as a student work experience opportunity with HPCC Systems. Curious about other projects we are offering? Take a look at our Ideas List.

Student work experience opportunities also exist for students who want to suggest their own project idea. Project suggestions must be relevant to HPCC Systems and of benefit to our open source community. 

Find out about the HPCC Systems Summer Internship Program.

Project Description

Historically, the HPCC Systems Platform team has relied on automated test systems called OBT – Overnight Build and Test systems - and the Smoketest (see repos listed in the table below) for regression and performance testing whenever a platform code change is made. These automated test systems generate comprehensive reports that allow QA testers and developers to quickly identify and troubleshoot issues within the code.

Recently, these automated test systems have been migrated to more modern DevOps approaches such as GitHub (GH) actions. However, the level of details from the reports generated by GH actions requires testers and developers to dig into archived logs to find out what went wrong and how to fix the reported issues. 

The primary goal of this project is to improve GH actions scripts to analyze the logs immediately after they are created and provide more detailed info for the developer/reviewer (this part can be implemented in Python).  The second goal is to improve fault tolerance of the test system. Sometimes GH actions fail because a resource is busy and there is only one attempt to get it. We can add some logic in GH action script to retry that operation (this part requires more GH action and Bash scripting work).  

Completion of this project involves:

There are two kinds of deliverables:

• Code, provided in GitHub Pull Requests from cloned repositories. (The original codes are executed regularly to support our development work, so they are untouchable directly by this project.)

• Documentation