Loading [Contrib]/a11y/accessibility-menu.js
Skip to main content
null
J Orthopaedic Experience & Innovation
  • Menu
  • Articles
    • Brief Report
    • Case Report
    • Data Paper
    • Editorial
    • Hand
    • Meeting Reports/Abstracts
    • Methods Article
    • Product Review
    • Research Article
    • Review Article
    • Review Articles
    • Systematic Review
    • All
  • For Authors
  • Editorial Board
  • About
  • Issues
  • Blog
  • "Open Mic" Topic Sessions
  • Advertisers
  • Recorded Content
  • CME
  • JOEI KOL Connect
  • search

RSS Feed

Enter the URL below into your favorite RSS reader.

http://localhost:21612/feed
Research Article
Vol. 4, Issue 2, 2023December 26, 2023 EDT

Publication History and Associated Academic Metrics of Selected Content Speakers at Arthroscopy Association of North America and American Orthopaedic Society for Sports MedicineAnnual Meetings

Edward J. Modica, Brandon Klein, DO, MBA, Lucas Bartlett, Adam Lencer, Nicholas Andriani, Randy M. Cohn, MD, Nicholas A. Sgaglione,
Sports MedicineEducationAcademiaAOSSMAANA
Copyright Logoccby-nc-nd-4.0 • https://doi.org/10.60118/001c.87623
J Orthopaedic Experience & Innovation
Modica, Edward J., Brandon Klein, Lucas Bartlett, Adam Lencer, Nicholas Andriani, Randy M. Cohn, and Nicholas A. Sgaglione. 2023. “Publication History and Associated Academic Metrics of Selected Content Speakers at Arthroscopy Association of North America and American Orthopaedic Society for Sports MedicineAnnual Meetings.” Journal of Orthopaedic Experience & Innovation 4 (2). https:/​/​doi.org/​10.60118/​001c.87623.
Save article as...▾
Download all (1)
  • Click here to start your pathway to continuing education!
    Download

Sorry, something went wrong. Please try again.

If this problem reoccurs, please contact Scholastica Support

Error message:

undefined

View more stats

Abstract

Background

Annual meetings held by the Arthroscopy Association of North America (AANA) and the American Orthopaedic Society for Sports Medicine (AOSSM) are important platforms for showcasing relevant sports medicine innovation and research. While meeting planning committees likely consider multiple factors when selecting content speakers, it may be assumed that these speakers are well-published or have an academic reputation on their topic of presentation.

Hypothesis/Purpose

To assess the peer-reviewed publication history and associated academic metrics of selected content speakers of prominent sports medicine society meetings and to identify content areas that lack speakers with previous peer-reviewed publications on their topic of presentation.

Study Design

Cross-Sectional Review

Methods

The 2016-2019 conference programs of AANA and AOSSM annual meetings were screened for selected content speakers. Each selected content speaker was searched in the Scopus database to identify prior peer-reviewed publications that were relevant to their presentation topic. Each selected content speaker, presentation, and content category was analyzed to determine the speakers’ Hirsch index (H-index), number of speakers’ previous topic-specific publications, manuscripts’ weighted citation count (WCC), and number of speakers using means and proportions. Comparisons were performed with two-sample T-tests for continuous variables and two-sample Z-tests for proportions for categorical variables, with p-values less than 0.05 indicating statistical significance.

Results

Of 432 total lectures, 371 (86%) were given by speakers who were previously published on their topic, leaving only 61 lectures (14%) by speakers without previous topic-specific publication (p=0.0005). Nonoperative sports medicine had the highest proportion (34%, 24/71) of lectures delivered by speakers without prior topic-specific publications. Speakers presenting on the hip had the highest H-index (41.67); speakers presenting on the elbow held the highest average number of prior topic-specific publications (12.17); and speakers presenting on biologics held the highest average WCC (8.56). There were no differences between conferences in regard to the proportion of speakers without previous topic-specific publications, the total average number of prior topic-specific publications per speaker, or the total average WCC.

Conclusion

The AANA and AOSSM annual meetings largely include selected content speakers with prior peer-reviewed literature. While publication history and associated academic metrics may be factors in speaker selection, each organization likely has its own individual selection criteria for delivering high-quality programs.

Click here to start your pathway to continuing education!

Introduction

Many medical societies hold annual meetings which showcase the latest in clinical practice, techniques, and research while offering medical professionals new educational opportunities (Kearney et al. 2019). The Arthroscopy Association of North America (AANA) and the American Orthopaedic Society for Sports Medicine (AOSSM) are widely regarded as two of the most prominent societies within orthopaedic sports medicine, each hosting their own annual meeting (Kinsella et al. 2015; Frank et al. 2017; Baweja, Kraeutler, and McCarty 2018).

Literature presented at these meetings is disseminated as presented abstracts or through lectures by selected content speakers. As lectures have the potential to influence clinical decision-making, an active role in recent literature may demonstrate that the speaker is well-versed in recent technological innovations. Previous studies have evaluated the future publication rates of presented abstracts at sports medicine annual meetings, but no study was identified that evaluated the publication history or associated academic metrics of their speakers (Kinsella et al. 2015; Frank et al. 2017; Baweja, Kraeutler, and McCarty 2018; Lehman et al. 2017). Hyer et al attempted to objectively measure the quality of selected speakers by evaluating speakers’ previous peer-reviewed publications on their presentation topic at foot and ankle society meetings. In their review, the majority of selected content speakers at prominent foot and ankle society meetings were not previously published on their presented topic (Hyer et al. 2022). While prior literature has suggested the use of topic-specific publications as a metric for gauging speaker quality, meeting planning committees likely consider a number of factors such as prominence in the field, prior high-quality lectures, society affiliation, and employment at academic centers.

In order to determine whether AANA and AOSSM rely on publication history and associated academic metrics during content speaker selection for the 2016-2019 annual meetings, the authors sought to answer the following questions: 1) What percentage of content speakers at sports medicine annual meetings have previous peer-reviewed publications on their presented topic?; 2) What are the publication-associated academic metrics of selected content speakers?; 3) Which content categories lack speakers with previous peer-reviewed publications on their presented topic?

Methods

The programs of 2016-2019 AANA and AOSSM annual meetings were accessed through the organization’s website or by contacting the organization when programs were not publicly available. Institutional Review Board (IRB) approval was not required for this review. Three authors independently screened each meeting program to identify selected content speakers. Only speakers who held a Doctor of Medicine (MD) or Doctor of Osteopathic Medicine (DO) degree were included. Content speakers were included if their speaker-assigned lectures were listed under the “Feature Lecture,” “Symposium,” “General Session,” and “Concurrent Session” subheadings in the final programs. Oral abstract and poster presentations, debates, instructional course lectures, industry or society-sponsored presentations, cadaveric workshops, medical-legal discourses, and business content were excluded to focus on those lectures given by invited speakers.

Prior peer-reviewed publications by selected content speakers were identified by searching the authors’ first and last names in the Scopus database (Amsterdam, Netherlands). For an identified manuscript to be included, the date of publication had to precede or include the year of the respective annual meeting. Conference papers, data papers, editorials, erratum, letters, notes, retracted articles, and short surveys were excluded. Abstracts of publications were assessed for relevance to the specific topic, and their full-length texts were subsequently reviewed to confirm relevance. Full-length manuscripts that were specific to the presented topic were included. For example, if the title of the lecture was “Meniscal Root Repair”, only publications pertaining to meniscal root repair were included. If the title was broader, such as “PCL,” then all publications pertaining to the posterior cruciate ligament were included. Authorship order of previous publications was not considered, and any authorship listing was considered a previous publication. Each author’s Scopus-listed Hirsch index (H-index), a metric that measures an author’s overall impact and productivity, specific to the year of the annual meeting, was recorded as listed on Scopus. It is defined as the number of publications with a citation number ≥ h . (Hirsch 2007, 2005; “Welcome to Scopus Preview,” n.d.) Hirsch states that after 20 years of scientific activity, an H-index of 20 is successful, 40 is outstanding, and 60 is “truly unique.” (Hirsch 2005) A weighted citation count (WCC) was calculated for each topic-specific publication by dividing the number of citations by the number of years since publication (Hyer et al. 2022). A WCC was used to assess the academic impacts of each prior publication. While manuscripts published at two different time points may have the same number of citations, the publication that is more recent would have a higher WCC, and thus an increased academic impact.

Each society designated lectures in their respective programs by content subcategories, but these subcategories were not aligned between societies. To maintain consistency, a total of nine content categories were created for which each lecture was assigned by the reviewers: biologics, elbow, foot and ankle, hand and wrist, hip, knee, nonoperative sports medicine, pediatrics, and shoulder. The nonoperative sports medicine category included content regarding injury prevention, performance enhancement, concussion management, and non-musculoskeletal topics. Lectures were assigned to the category most representative of their topic, with disputes determined by a third reviewer when necessary. The categories were analyzed for the average number of speakers, H-index, number of previous topic-specific publications, and WCC.

The number of lectures, H-index, number of previous topic-specific publications, and WCC for each society and topic were analyzed using means and proportions. Comparisons were performed with two-sample T-tests for continuous variables and two-sample Z-tests for proportions for categorical variables, with p-values less than 0.05 indicating statistical significance.

Results

A total of 432 lectures met inclusion criteria and were eligible for final analysis. Overall, 371 lectures (86%) were given by speakers who previously published on their presented topic, while only 61 lectures (14%) were given by speakers who were not previously published on their presented topic (p<0.001). The majority of selected content speakers had between 1-10 prior topic-specific publications (58%), followed by those with more than 20 previous topic-specific publications (11%).

The most commonly presented lecture categories were knee (30%, 129/432), shoulder (30%, 128/432), and nonoperative sports medicine (16%, 71/432). Hand and wrist was the least frequently presented topic (0.7%, 3/432). Nonoperative sports medicine had the highest percentage (34%, 24/71) of lectures delivered by speakers without prior topic-specific publications, followed by foot and ankle (13%, 2/15) and biologics (13%, 2/16).

The average H-index of speakers was 35.5. Speakers presenting on the hip held the highest average H-index (41.7). The average number of prior topic-specific publications by selected content speakers was 9.6. Speakers presenting on the elbow had the most prior topic-specific publications (12.2). The average WCC of speakers was 4.8. Those presenting on biologics had the highest average WCC (8.6). (TABLE 1)

Table 1.Overall Statistics
Category Speakers (%) Speakers with No Prior Topic-Specific Publications (%) Average H-index Average Number of Prior Topic-Specific Publications Average WCC
Total - 14.1 35.5 9.6 4.8
Hip 11.8 9.8 41.7 9.5 5.6
Knee 29.9 11.6 38.5 11.5 5.3
Foot & Ankle 3.5 13.3 17.1 8 3.7
Hand & Wrist 0.7 0 10.3 5.3 0.9
Elbow 2.8 8.3 39.8 12.2 2.3
Shoulder 29.6 9.4 34.7 8.5 4.6
Pediatrics 1.6 0 28.7 8 6
Nonoperative Sports Medicine 16.4 33.8 31 8 3.6
Biologics 3.7 12.5 41 11.9 8.6

Overall, over half of the lectures were related to the knee or shoulder. Nonoperative sports medicine was the only content category with an above-average proportion of speakers without prior publication. Selected content speakers presenting on biologics comprised only 3.7% of speakers, but those speakers were among the top in average H-index, average number of prior topic-specific publications, and average WCC compared to other categories.

Among AANA and AOSSM speakers, nonoperative sports medicine was the only category with more than 20% of speakers having no prior topic-specific publications (29% and 35%, respectively). AOSSM speakers had a greater average H-index than speakers at AANA (37.3 v. 32.5, p=0.027). Otherwise, there was no difference between meetings in the proportion of speakers without prior topic-specific publications (16% v. 13%, p=0.412), the total average number of prior topic-specific publications (9.4 v. 9.7, p=0.882), or the total average WCC (5.3 v. 4.5, p=0.146). (TABLE 2) (TABLE 3)

Table 2.AANA Statistics
Category Speakers (%) Speakers with No Prior Topic-Specific Publications (%) Average H-index Average Number of Prior
Topic-Specific Publications
Average WCC
Total - 15.6 32.5 9.4 5.3
Hip 14.4 17.4 36.6 7.8 6.9
Knee 28.1 17.8 33.2 7.1 5
Foot & Ankle 2.5 0 30 16 9.1
Hand & Wrist 0 - - - -
Elbow 3.1 20 42.4 18 1.6
Shoulder 40 10.9 28.9 9.3 5.1
Pediatrics 0 - - - -
Nonoperative Sports Medicine 8.8 28.6 13.4 13.4 4.1
Biologics 3.1 20 37.8 16 7.5

Although shoulder was the most commonly presented topic at AANA annual meetings, selected content speakers of this category were below average in H-index, average number of prior topic-specific publications and average WCC when compared to other content categories. Selected content speakers presenting on elbow held a higher average H-index and average number of prior topic-specific publications when compared to all other content categories.

Table 3.AOSSM Statistics
Category Speakers (%) Speakers with No Prior Topic-Specific Publications (%) Average H-index Average Number of Prior Topic-Specific Publications Average WCC
Total - 13.2 37.3 9.7 4.5
Hip 10.3 3.6 45.8 10.8 4.5
Knee 30.9 8.3 41.3 13.8 5.4
Foot & Ankle 4 18.2 12.5 5.1 1.8
Hand & Wrist 1.1 0 10.3 5.3 0.9
Elbow 2.6 0 37.9 8 2.8
Shoulder 23.5 7.8 40.4 7.7 4.1
Pediatrics 2.6 0 28.7 8 6
Nonoperative Sports Medicine 21 35.1 29.9 6.7 3.5
Biologics 4 9.1 42.5 10.1 9

Knee was the most commonly presented topic at AOSSM conferences. Selected content speakers presenting on knee scored among the top three content categories in average H-index, average number of prior topic-specific publications, and average WCC. While there were not many selected content speakers presenting on biologics, these speakers possessed an average h-index, number of prior topic-specific publications, and WCC among the top three compared to all content categories.

Discussion

Annual meetings have the potential to impact clinical practice, and thus it is important to ensure that speakers are active in current literature. While it may be assumed that orthopaedic societies value prior publication when selecting content speakers for their annual meetings, recent literature has suggested that other factors may play a larger role in speaker selection (Hyer et al. 2022). Using the presence of prior topic-specific publication as an objective measurement of speaker quality, Hyer et al found that roughly 71% of guest speakers at prominent foot and ankle society annual meetings were not previously published on their presented topic (Hyer et al. 2022). The previous publications and associated academic metrics of selected content speakers at orthopaedic sports medicine meetings had not been previously assessed.

Our analysis demonstrates that the majority of selected content speakers at orthopaedic sports medicine society meetings have prior peer-reviewed publications on their topic of presentation. Each conference had more than 80% of speakers with prior topic-specific publications. In contrast to the previous review of foot and ankle society meetings, both sports medicine societies demonstrated a much smaller proportion of selected content speakers without prior topic-specific publications (Hyer et al. 2022). However, publication history cannot be considered a reliable metric of speaker quality, as the specific criteria utilized by individual societies for speaker selection may or may not include publication history.

Categories with the fewest number of speakers without previous topic-specific publications included pediatrics (0%), hand and wrist (0%), and elbow (8%). However, these categories also constituted the lowest number of total speakers. While these categories are presented infrequently at the sports medicine society meetings, they are more likely to be presented by speakers with prior topic-specific publications. Conversely, the categories with the highest proportion of speakers with no prior topic-specific publications were nonoperative sports medicine (34%), foot and ankle (13%), and biologics (13%). Despite foot and ankle lectures having a relatively high proportion of speakers without prior publication, this percentage of speakers with a publication history was greater than previously reported on foot and ankle society meetings (Hyer et al. 2022). However, the majority of speakers in these content categories exhibited prior topic-specific publications with comparable average H-indexes and WCC to other categories. To ensure adequate incorporation of recent innovations within nonoperative sports medicine, foot and ankle, and biologics, greater consideration of the speaker’s previous publications in these content areas may improve future annual meetings.

There were no differences between the AANA and AOSSM annual meetings in regard to the proportion of speakers without previous topic-specific publications, the total average number of prior topic-specific publications per speaker, or the total average WCC. As previously suggested, Hirsch et al. reports that an H-index of 20 is considered successful (Hirsch 2005). Both AANA and AOSSM speakers had an average H-index over 30, suggesting that speakers were highly successful in academic research. While AANA and AOSSM did differ in H-index, both conferences exhibited superior H-indexes, number of prior topic-specific publications, and WCC compared to the findings reported by Hyer et al (2022). These findings suggest that AANA and AOSSM program committees may emphasize publication history and academic metrics more than their foot and ankle counterparts.

Disparities in publication-specific metrics between society meetings may be attributed to the selection criteria of each individual meeting committee. While previous research may be one factor that is considered when selecting speakers for national meetings, other factors that may influence committee decisions include prominence in the field, prior high-quality lectures, societal affiliation, or employment at academic centers. Lectures by prominent orthopaedic surgeons and speakers with a history of high-quality presentations may drive meeting attendance and thus are likely to be valued by the meeting committees. Society affiliation can also exert influence, as societies may be more apt to extend invitations to individuals who have displayed committed engagement with the society. Additionally, physicians affiliated with academic centers possess valuable experience that may contribute to the quality of lectures, including their active engagement in research and involvement in the teaching of medical trainees. While we may speculate on what influences committee decisions, each society likely has its own unique formula for speaker selection based on years of experience in delivering high-quality meeting programs.

This study is not without limitations. Categories were created by the authors and thus subjectivity may exist in classification. Although a detailed review of programs was performed by two authors, there may have been previous publications that were not properly identified or incorrectly included in the analysis. To minimize this limitation, a third reviewer was queried for disagreements between categorization of the other two reviewers. Due to the exclusion of all speakers without an MD or DO degree, it is possible that published speakers without these degrees were omitted. Our methods did not account for the possibility of ongoing research that may be known to members of the program planning committee. To account for emerging research for which the speaker may be discussing, authors included all manuscripts published within the same year as the annual meeting. While most of the categories were well represented, three categories (hand and wrist, elbow, pediatrics) had less than 15 speakers, and thus the data may be underpowered to detect statistical significance. Although this review assessed the academic metrics of selected content speakers, authors acknowledge that a variety of other factors likely contribute to speaker selection. Individual program planning committees may value clinical practice experience and those with organization affiliations. These factors, as well as the surgeon’s practice setting (academic versus private), may influence selection but were not evaluated in this study. While authors acknowledge the tremendous importance of racial and gender equality within content speakers, these factors were not evaluated as authors would have had to assume gender and ethnicity, as this information is not often readily available.

Conclusion

AOSSM and AANA annual meetings largely include selected content speakers with prior peer-reviewed literature on their presentation topic. While prior publications and associated academic metrics may be a factor in speaker selection, each society likely has its own individual selection criteria for delivering high-quality programs.

Submitted: June 15, 2023 EDT

Accepted: August 29, 2023 EDT

References

Baweja, Rishi, Matthew J. Kraeutler, and Eric C. McCarty. 2018. “An In-Depth Analysis of Publication Characteristics of Podium Presentations at the Arthroscopy Association of North America Annual Meetings, 2011-2014.” Arthroscopy: The Journal of Arthroscopic & Related Surgery 34 (3): 884–88. https:/​/​doi.org/​10.1016/​j.arthro.2017.09.026.
Google Scholar
Frank, Rachel M., Gregory L. Cvetanovich, Michael J. Collins, Thomas A. Arns, Austin Black, Nikhil N. Verma, Brian J. Cole, and Brian Forsythe. 2017. “Publication Rates of Podium Versus Poster Presentations at the Arthroscopy Association of North America Meetings 2008-2012.” Arthroscopy: The Journal of Arthroscopic & Related Surgery 33 (1): 6–11. https:/​/​doi.org/​10.1016/​j.arthro.2016.07.019.
Google Scholar
Hirsch, J. E. 2005. “An Index to Quantify an Individual’s Scientific Research Output.” Proceedings of the National Academy of Sciences 102 (46): 16569–72. https:/​/​doi.org/​10.1073/​pnas.0507655102.
Google ScholarPubMed CentralPubMed
———. 2007. “Does the H Index Have Predictive Power?” Proceedings of the National Academy of Sciences 104 (49): 19193–98. https:/​/​doi.org/​10.1073/​pnas.0707962104.
Google ScholarPubMed CentralPubMed
Hyer, Christopher F., Dominick J. Casciato, Calvin J. Rushing, and John M. Schuberth. 2022. “Incidence of Scholarly Publication by Selected Content Experts Presenting at National Society Foot and Ankle Meetings From 2016 to 2020.” The Journal of Foot and Ankle Surgery 61 (6): 1317–20. https:/​/​doi.org/​10.1053/​j.jfas.2022.04.011.
Google Scholar
Kearney, Peter, Maarten Simoons, Lars Ryden, Paulus Kirchhof, Axel Pries, Colm O’Morain, and Jeroen J. Bax. 2019. “The Medical Profession, Industry, and Continuing Medical Education: Finding the Balance That’s Right for Patients.” The American Journal of Medicine 132 (8): 921–25. https:/​/​doi.org/​10.1016/​j.amjmed.2019.02.026.
Google Scholar
Kinsella, Stuart D., Travis J. Menge, Allen F. Anderson, and Kurt P. Spindler. 2015. “Publication Rates of Podium versus Poster Presentations at the American Orthopaedic Society for Sports Medicine Meetings: 2006-2010.” The American Journal of Sports Medicine 43 (5): 1255–59. https:/​/​doi.org/​10.1177/​0363546515573939.
Google Scholar
Lehman, Jason D., Benedict U. Nwachukwu, Richard Ferraro, Brian J. Rebolledo, Eric C. Makhni, Nikhil N. Verma, and Lawrence V. Gulotta. 2017. “Publication Rates of Podium Presentation Abstracts at the Arthroscopy Association of North America Annual Meetings 2004-2012.” Arthroscopy: The Journal of Arthroscopic & Related Surgery 33 (4): 835–39. https:/​/​doi.org/​10.1016/​j.arthro.2016.11.023.
Google Scholar
“Welcome to Scopus Preview.” n.d. Scopus. Accessed April 15, 2023. https:/​/​www.scopus.com/​home.uri.

This website uses cookies

We use cookies to enhance your experience and support COUNTER Metrics for transparent reporting of readership statistics. Cookie data is not sold to third parties or used for marketing purposes.

Powered by Scholastica, the modern academic journal management system