Mobile Performance TestNSW Government Agency
Case Study – NSW Government Agency
A NSW government agency had a requirement to performance test a new version of their emergency fires/hazards mobile in readiness for the fires season. The main performance requirement was to simulate the performance of the backend infrastructure for a worse case scenario and also for resiliency against 25 million watch–zones within all the states in Australia and to create 25 million notifications in under 30 minutes or as near to that target. The backend infrastructure was on AWS using Lambda for serverless, SQS queues and SNS for notifications. S3 buckets were there to store the feeds using the CAP-AU standard format from the various Jurisdictions. Spatial data was created via R to simulate the creation of watch–zone based on Geolocation data which form the input into Golang script that used to create the 25 million watch–zones for faster processing within the infrastructure. Jmeter was then used to create the load scripts and then to execute the performance test. Several bottlenecks were found in the early cycles and recommendations were given to the vendor to improve on performance to reach the acceptable NFR. Some design constraints were found as part of the performance testing. Other tests that were performed were resilient tests to ensure redundancy to ensure notifications don’t get lost and can be resubmitted if they go to a specific retransmission queue.