Logo

Customer Case Study

Tests in Parallel: How HYPR Reduces Build and Test Time with Orka

HYPR uses Orka to effortlessly run QA tests in parallel and streamline their Mac development process to reduce build and test time.

About HPYR

HYPR provides advanced identity security solutions, focusing on passwordless authentication, adaptive risk mitigation, and automated identity verification. Their platform integrates with existing security tools and is trusted by enterprises worldwide, supporting over 20 million users.



The HYPR team consists of over 50 developers split across iOS, macOS, Windows, and Android, and a Quality Assurance (QA) team of 8. The HYPR QA team tests nodes for functionality and reliability, while working to ensure that the platform performs smoothly in complex environments.

It all started with inefficient self-hosted Macs

In HYPRs early days, a handful of physical Mac minis were used for iOS development. As the company grew, this setup became unsustainable. Development shifted to local machines and carried its own set of challenges. It became clear that a more scalable solution was needed.



They searched for a better solution and quickly found MacStadium. With the initial launch on VMware with MacStadium Bare Metal, they formed a development pipeline for Mac and started their journey to streamlined macOS build and test.



HYPR found that one of the biggest pain points with VMware was image management. The QA team found it extremely difficult to set up new images and maintain base images while installing patches over time.

The quick and easy process of transitioning from VMware to Orka

HYPR migrated from VMware to Orka to streamline macOS testing. With no time to waste, they were able to get their GitLab pipeline up and running on Orka in under a month.



Compared to VMware’s complicated and overly complex interface, Orka’s CLI tools are easier to use and straightforward.

“Before with VMware, we were manually managing all the OSs. Now with Orka, we can just pull the new images whenever we want. Orka made it easier for us to dynamically scale up and down workers to spin up more QA automations.”
- Sean Torpey, Director of Quality Engineering at HYPR

Orka helps the HYPR team significantly shrink their testing backlog. With VMware, tests would take around 11 hours with strategically allocated resources to avoid frequent crashes. With Orka, the QA team is confident that they can get testing down to 5 hours or less – Increasing time saved by over 50%.



“With MacStadium, we can run tests and install software, then shut it down,” says Sean Torpey, Director of Quality Engineering at HYPR. “It opened up a lot of automation opportunities for the Mac side of things, like running simulator tests in Xcode. It's the best place for us to do Mac version and Mac browser testing.”

Effortless QA tests in parallel with Orka

Orka allows HYPR to easily upgrade the OS on the build machines by running a quick test on a node in parallel to confirm that it’s properly functioning. The QA team is now able to upgrade nodes and/or tests in parallel to active testing. Before coming to MacStadium, the process could take nearly an entire day (as long as 22 hours).

"One of the biggest impacts we’ve seen is seeing results right away with Orka. It has really reduced the time that it takes to do the development of the tests.”
- Sean Torpey, Director of Quality Engineering at HYPR

Another big area of opportunity for the QA team is related to managing testing for their Adapt and Affirm products. The team is hoping to automate complex scenarios for an even smoother process going forward. Their ultimate goal is to improve builds, coverage, and optimize testing on the latest OS with integrations.



With the help of Orka, HYPR can confidently incorporate macOS 15 Sequoia directly into their pipeline, making the process easy and repeatable for implementing a new OS and patching an existing OS.

Conclusion

HYPR’s transition to MacStadium’s Orka solution transformed their macOS testing from a slow, manual process into a streamlined, scalable operation. Orka’s simple CLI and dynamic image management help HYPR run complex and parallel tests effortlessly.



Thanks to Orka, HYPR’s development pipeline is faster and more efficient, allowing them to stay ahead with the latest macOS versions while focusing on delivering top-tier identity security solutions.

Top Benefits:

✔ Painless and quick migration from VMware to Orka



✔ Go from manual and tedious testing to streamlined same-day QA tests



✔ Run parallel tests alongside dynamic image management

“One of the biggest impacts we’ve seen is seeing results right away with Orka. It has really reduced the time that it takes to do the development of the tests.”



Sean Torpey, Director of Quality Engineering at HYPR

Logo

Orka, Orka Workspace and Orka Pulse are trademarks of MacStadium, Inc. Apple, Mac, Mac mini, Mac Pro, Mac Studio, and macOS are trademarks of Apple Inc. The names and logos of third-party products and companies shown on the website are the property of their respective owners and may also be trademarked.

©2024 MacStadium, Inc. is a U.S. corporation headquartered at 3525 Piedmont Road, NE, Building 7, Suite 700, Atlanta, GA 30305. MacStadium, Ltd. is registered in Ireland, company no. 562354.