Great article about how to correctly implement the QA process in a CI environment. Written by The Guardian's software architect Andy Hume.
"When you're releasing code multiple times a day, you don't have time for full regression tests. Running a full set of integration tests across all browsers can take many minutes, if not hours. When we merge code to the master branch, we run a full set of unit tests on the Scala and JavaScript codebase, as well as check the output of some key application endpoints in a headless browser. These take five to 10 minutes to run. If they pass, the code is automatically deployed to a continuous integration environment. Developers can sanity check their changes in this environment, and if they're happy (and with the conscience of the team on their shoulders), can immediately deploy to production. Once the code is in production, QA can really start..."
Continued at:
http://www.guardian.co.uk/info/developer-blog/2012/dec/06/real-time-qa-confident-code
http://timothyfitz.com/2009/02/10/continuous-deployment-at-imvu-doing-the-impossible-fifty-times-a-day/
ReplyDelete