Re: Regarding The PGWeb Testing Harness Suite Development in GSOC 2023

On 5/17/23 2:04 PM, Akshat Jaimini wrote:
> Hello everyone!
> 
> We are pleased to announce that the PGWeb Testing Harness Suite for the 
> official website is being developed in GSOC 2023.
> 
> You can checkout the repository for the project here: 
> https://github.com/destrex271/pgweb-testing-harness 
> <https://github.com/destrex271/pgweb-testing-harness> where we'll have 
> all the tests that would be written for the website.

Thanks, this sounds like a great effort.

> It would be amazing if you guys have any suggestions like the features 
> that you would like to have in the project. As of now we are focusing on 
> implementing the functional tests(that includes testing out the links 
> and other interactive elements on the website) using Selenium.

If you want to start with a "challenging" one, I can give a real use 
case where functional tests would have helped. We have a series of pages 
that render information about the release notes[1][2]. There was a 
recent refactor of the code to simplify the implementation of rendering 
a page like [2], but when it was deployed to production, there were 
numerous errors, even after manual testing. Having a thorough set of 
functional tests should have caught most of them, or at least made it 
easier to ensure we were testing for more cases.

I haven't written interactive tests in awhile with Selenium, but back 
when I did, my experience is that it would be too much for the kind of 
interactivity the PostgreSQL website has. The Django test client[4] may 
be good enough for what we need, but I'm happy to be corrected on this.

Thanks,

Jonathan

[1] https://www.postgresql.org/docs/release/
[2] https://www.postgresql.org/docs/release/15.3/
[3] https://github.com/postgres/pgweb/blob/master/pgweb/docs/views.py#L307
[4] https://docs.djangoproject.com/en/4.2/topics/testing/tools/