[Discussion] Highlight Keywords and Description more on resource details page?

[andrewsu]

For discussion/consideration.... Right now, there are sections for Overview, Keywords, Description, Provenance, Funding, and Metadata. Would it be worth considering pulling out the Keywords and Description to be a more integrated part of the page (under the resource title, perhaps)? I think this could bring information higher that would be useful to the user at first glance.

[gtsueng]

The coverage of description is generally very high >90%, but I'm not sure about the coverage of keywords. @leandrocollares can you check the coverage of the keywords field currently on production? This will let us know how much impact this UI improvement might have.

[gtsueng]

Keyword coverage is here: https://docs.google.com/presentation/d/173iq49N4FRulkf7R-s-L3defEDY2hjEzxnQvBQKo7Kk/edit#slide=id.g2f10e6bde1c_0_158

@DylanWelzel to provide a dump of description for @leandrocollares to analyze. Description length will play an important role in determining whether or not ChatGPT can be used to generate a short description of the Dataset. (It tends to over hallucinate for topicCategory and measurementTechnique) when the name+description of a dataset is too short

[leandrocollares]

Description coverage and other stats: https://docs.google.com/presentation/d/173iq49N4FRulkf7R-s-L3defEDY2hjEzxnQvBQKo7Kk/edit#slide=id.g2f153f9f748_0_8

[gtsueng]

Other considerations:

• length limitations of ChatGPT before hallucinating results for measurementTechniques: https://docs.google.com/spreadsheets/d/1crfLDl5_c7jZ47JefhOCf6tx_cM-u8AkK6rsXttM6s8/edit?gid=1639648736#gid=1639648736
• Title length optimization for SEO is ~70-80 characters
• Description length optimization for SEO is ~140 - 160 characters
• The ~<400 character range appears to have around the same number of records as the ~<50 word range (and there are ~1 million records within this character/word length range)
• The current character limitation for the display of the description in the current search results/card view is ~180 characters. Descriptions greater than this length are displayable after clicking on the interactive element.

Since keyword coverage is so low/messy at this point in time, I'm going to split this issue into 2. We can revisit the placement of keywords in the future (when we've standardized/augmented this field). We can move forward with generating improved descriptions (NIAID-Data-Ecosystem/nde-crawlers#159)

This issue has been split into the following issues:

• keywords:
  • Metadata improvement of keywords
  • UI improvement of keywords
• descriptions:
  • UI testing for improvement of description display
  • Generate abstracts for improvement of description display
  • UI improvements of description display

I am marking this issue as pending close out and will close it after a week. If you have additional comments on the prominence of keywords or descriptions, please add them to the appropriate ticket, rather than this one.