What Do We Want and Need from Smoke Testing?

James E Keenan

Perl 5 Core Hackathon - 2017
Amsterdam, Netherlands
October 14 2017

Table of Contents

1. Introduction
2. Five Levels of Testing

3. Individual Committer

4. Integration Testing
5. Level 1: Integration Testing (cont'd)

7. Smoke Testing
8. Level 2: Smoke Testing (cont'd)

10. Testing CPAN against Blead
11. Level 3: CPAN (cont'd)

12. Testing Downstream against Blead
13. The "Autoconf Problem"
14. Autoconf Presumes '.' in @INC
15. Next Steps: A Tertiary Test Suite?
16. A Tertiary Test Suite

17. Summary
18. The End
19. References

20. Bonus Slides
21. The "Go Test Suite Problem"
23. Individual Smoke Test Reports
24. Capture Compiler Warning
25. lib/locale.t: Failures on FreeBSD-11.0