Content and usability validation of the Retire with Health web software

a methodological study. The content validation was carried out by seven experts in the aging subject, using an instrument that evaluated the objectives, contents, relevance, and the environment of the web software. Usability was validated by seven experts in software development, referring to ergonomics, functionality, usability, and efficiency. The data were submitted to statistical analysis, described by calculating the Content Validity Index.

Results:

the global Content Validity Index found 0.97 for the usability aspects and 1.00 for the content. After incorporating all the experts’ suggestions, the Retire with Health web software was made available on the internet (www.aposentarsecomsaude.com.br).

Conclusions:

content validation and usability showed that the web software meets the objective of supporting reflection on retirement, with a high level of agreement among experts.

Descriptors:
Validation Study; Software; Hypermedia; Occupational Health; Retirement

Validation Items	Percentage of agreement			CVI^* * Content Validity Index.
	Totally Inadequate	Somehow Adequate	Totally Adequate
	%	%	%
1 Objectives
1.1 The objectives of web software are consistent with the practice of retirement planning.	-	-	100	1.00
1.2 The web software allows the understanding of the retirement planning theme.	-	42.9	57.1	1.00
1.3 The proposed objectives are adequate for its effectiveness.	-	14.3	85.7	1.00
2 Content
2.1 The contents of the web software correspond to its objectives.	0	28.6	71.4	1.00
2.2 The contents of the web software are enough to achieve the objectives proposed.	0	28.6	71.4
2.3. The contents of the web software accurately reach the scope of the theme.	0	42.9	57.1	1.00
2.4 The information presented is correct.	0	0	100	1.00
2.5 The language is appropriate to the target audience's different levels of knowledge.	0	28.6	71.4	1.00
2.6 The contents allow the understanding of the different dimensions of retirement planning.	0	28.6	71.4	1.00
3 Relevance
3.1 The contents allow the understanding of the different retirement planning dimensions.	0	14.3	85.7	1.00
3.2 The contents of the web software are relevant so that the worker can identify the areas of greatest weakness concerning retirement planning, as well as seek strategies for better performance	0	28.6	71.4	1.00
4 Environment
4.1 The environment is suitable for presenting the content.	0	28.6	71.4	1.00
4.2 The environment is suitable for understanding the retirement planning theme.	0	14.3	85.7	1.00
Total	-	23.1	76.9	1.00

Dimensions	Suggestions/Considerations	Decision
Objectives	Check the possibility of including other reasons for retirement, which may not occur due to time, but due to other needs (taking care of a family member, emotional exhaustion, due to illness/disability, etc.).	Content to pursue a reflection on the reasons for retiring was included. Available as part of the "Emotional, Cognitive and Motivational Aspect" icon, accessed after filling the Inventory of Resources for Retirement.
Contents	I suggest that the system save the answers to the questionnaire with the date, so that the user can enter and go directly to the supporting texts for each dimension. The option of recording the responses with the date would also allow the user to respond after a while and compare the results, noting whether he has advanced in his difficulties.	It was included the option "Login" for the system to save the users' responses according to the date of completion. Also, all responses are forwarded via email to the user, along with the Informed Consent Form, and the user can access the responses' history and scores by clicking on the login icon on the web software homepage.
Contents	The page is well designed, publishes important, regular, and current information. However, I suggest publishing more information about pre-retirement and its planning in all aspects involved, such as psychological, social, health promotion and financial.	New content was added to the News screen, aimed at retirement planning.
Relevance	The contents are very relevant, very well written, "user friendly".	No adjustments were made to the relevance dimension.
Environment	Think about giving the option of not revealing the person's name in the experiences' statements if they do not want to be identified. Congratulations on the project. I was curious to know what web software about retirement was, and I liked it.	The identification option on the experiences screen was readjusted for non-mandatory filling.
Environment	Even knowing that retirement and aging are closely related, I think they could also bring images of women aged 60 and over, but with a youthful look. It captured my attention the predominance of images of white-haired women in the web software.	The images of the web software were changed, to relate them to healthy aging.

Validation Items	Percentage of agreement			CVI^* * Content Validity Index.
	Totally Inadequate	Totally Inadequate	Totally Inadequate
	%	%	%
1 Ergonomics
1.1 The user can Exchange from one screen to another quickly	14.3	-	85.7	0.85
1.2 The placement of the data is kept consistently from one screen to another.	14.3	-	85.7	0.85
1.3 Texts and style resources (eg underline, bold, italics) are used properly.	-	57.1	42.9	1.00
1.4 Controls and commands are clearly differentiated from the information presented on the screens.	-	14.3	85.7	1.00
1.5 Selected items become highlighted from the others.	-	429	57.1	1.00
1.6 Error messages are concise and to the point.	-	286	71.4	1.00
2 Functionality
2.1 The web software is suitable for the proposals for which it is intended.	-	143	85.7	0.85
2.2 The web software performs the proposed functions correctly.	-	-	100	0.85
2.3 The web software favors to generate positive results.	-	-	100	1.00
3 Usability
3.1 The web software is easy to use.	-	286	71.4	1.00
3.2 It is easy to learn the concepts and applications of web software.	-	143	85.7	1.00
3.3 The web software allows the worker to easily apply its content.	-	286	71.4	1.00
4 Efficiency
4.1 The response time of the web software is suitable for the worker to access the content available on different screens.	-	-	100	1.00
4.2 The organization of themes in different screens of the web software is suitable for a good understanding of the content, as well as the easy location of the desired theme.	-	429	57.1	1.00
Total	2,0	194	78.6	0.97

Dimensions	Suggestions/Considerations	Decision
Ergonomics	There are some coding errors on the pages.	Adjustments and tests were carried out to ensure proper working.
Ergonomics	Adjusting the icon that indicates the progress on the "Interview" screen. Use a "JS" to make the Input visible only when necessary. Example: if radio button equal to OTHER, visible Input.
Functionality	No suggestions were made.	No adjustments were made.
Usability	No suggestions were made.	No adjustments were made.
Efficiency	The great number of questions, inform how many questions make up the interview stage.	The information on the number of questions in the Sociodemographic and Occupational Questionnaire and Inventory of Resources for Retirement was inserted in the initial Interview screen was inserted.

Associação Brasileira de Enfermagem SGA Norte Quadra 603 Conj. "B" - Av. L2 Norte 70830-102 Brasília, DF, Brasil, Tel.: (55 61) 3226-0653, Fax: (55 61) 3225-4473 - Brasília - DF - Brazil
E-mail: reben@abennacional.org.br

Acompanhe os números deste periódico no seu leitor de RSS

[1] Corresponding author: Paloma de Souza Cavalcante Pissinati. E-mail: cavalcanteps7@gmail.com