News from the Accelerator- September 2021

Elections

The Psychological Science Accelerator (PSA) is accepting self-nominations for Assistant Directors of our Project Monitoring, Data & Methods, Study Selection, and Funding Committees! Assistant Directors directly shape the direction of the PSA any many ways, including (a) helping establish committee-specific vision plans to help the PSA achieve its mission and adhere to its core principles, (b) overseeing day-to-day committee-specific operations, and (c) providing regular updates to the PSA Director and Associate Directors about progress and problems. They are elected by majority vote by the PSA Board of Directors and serve 3 year terms. All who are interested are encouraged to apply here: https://forms.gle/ZNyhZCz4GenazbYG6

Study updates:

  • PSA-002 (Object Orientation): The lead team has submitted the manuscript to PBR and is now awaiting feedback.
  • PSA-003 (Gendered Prejudice): The lead team is finalizing translation and preparing for data analysis. Thanks to all who reached out following the last newsletter’s request for help with translation!
  • PSA-004 (Accelerated CREP): The lead team is currently working on data processing, data analysis, and authorship credit tracking. They are also looking for people to code open-ended responses for Chinese, Russian, and Greek. Contact Savannah to help with coding (slewis16@ashland.edu).
  • PSA-005 (Stereotype Threat): Data collection will resume on October 11, 2021. The lead team has created a checklist on Canvas to guide labs in preparations for data collection. Each collaborator should have been added to the Canvas course. If you have not please email psa005stero@gmail.com!
  • PSA-006 (Trolley Problem): The lead team has submitted the Stage II submission to Nature Human Behavior.
  • PSA-007 (SPAM-L): SPAML is still recruiting collaborators, with contribution opportunities available through the Words2Many and Subs2Strudel pre-projects. The lead team has begun the first rounds of the registered report and will soon be sending these out to contributors for feedback. If you are interested in becoming a collaborator or want to learn more about 007 please email 007spaml@gmail.com
  • PSA-COVID Rapid Bundle (001/002/003)- 
    • PSACR001 (Loss Gain) has been submitted to Affective Science.
    • PSACR002 (Cognitive Reappraisal) has been published in Nature Human Behavior.
    • PSACR003 (Self Determination) was resubmitted to PNAS.

PSACON

Today is the last day to submit a presentation to the second annual PSA CON!! October 27th is the deadline for registration. See you all there!

Canvas

The PSA is slowly integrating our new membership website to Canvas. We will be starting to add in every member in the next couple of months. Be sure to check your inbox for your invitation.

News from the Accelerator- August 2021

Quick read: 

  • The PSACR-002 Cognitive Reappraisal project is now published in Nature Human Behaviour
  • The PSA virtual conference is still accepting presentation submissions and registration is still open! 
  • The PSA membership website is moving to Canvas. Each member will get an email soon with instructions regarding next steps.  

Study updates:

  • PSA-002 (Object Orientation): PSA-002 got a lot of great feedback on the Stage 2 manuscript from collaborators. The lead team is working through the feedback and plans to send collaborators an updated manuscript for additional feedback very soon.
  • PSA-003 (Gendered Prejudice): The lead team is currently in the process of translating the open-ended participant responses. Several languages have completed the translation process, and the lead team is soliciting volunteers for the remaining languages (Portuguese, Polish and Chinese).
  • PSA-004 (Accelerated CREP): The lead team is currently working on data processing, data analysis, and authorship credit tracking. 
  • PSA-005 (Stereotype Threat): The lead team anticipates starting in-person data collection on Monday, October 11, 2021. The team will also be recruiting new collaborators until Friday, September 3, 2021. If you are interested in becoming a collaborator or want to learn more about 005 please email psa005stero@gmail.com.
  • PSA-006 (Trolley Problem): The lead team has submitted the Stage II submission to Nature Human Behaviour and is waiting for feedback.
  • PSA-007 (SPAM-L): SPAM-L is still recruiting collaborators for the Words2Many and Subs2Strudel pre-projects. SPAM-L admin team is also working on putting together IRB documents (if necessary), and the lead team is working on drafting a  Registered Report. If you are interested in becoming a collaborator or want to learn more about PSA-007, please email 007spaml@gmail.com
  • PSA-COVID Rapid Bundle- 
    • PSACR-001 (Loss Gain) has been submitted to Affective Science.
    • PSACR-002 (Cognitive Reappraisal) is published in Nature Human Behavior.
    • PSACR-003 (Self-Determination) is incorporating coauthor feedback in preparation for a resubmission to PNAS.

Canvas

The PSA is slowly integrating our new membership website to Canvas. Canvas is designed for teaching, so many of the terms online are focused on teaching – but we plan to explore Canvas as a project management tool. We have officially added every PSA member to the system. You should get an email in the next couple of weeks saying you have been added to our PSA membership course. You should also receive an email containing a guide for how to navigate this new membership website

PSA Virtual Conference (PSACON)

This year’s conference will take place on Oct 28th, 29th and 30th from 7:00 to 19:00 UTC. You can now see our drafted schedule and booklet to see some of our exciting presentations. If you have not already, you can register and submit a presentation for the second annual virtual PSA CON! This year’s conference looks like it will be very exciting, and we have thus far been able to accommodate all members who have requested free access to the conference. We look forward to seeing you there! 

Open Science SEA

The PSA is partnering with the Advancing Science in Southeast Asia Web Conference 2021! The conference will be held virtually on October 29, 2021, and you can still register at http://sciencesea2021.com

Releasing the Results of the PSA’s COVID-Rapid Project

The PSACR Administrative Leadership Team
Heather Urry, Hannah Moshontz, Charles Ebersole, Jeremy K. Miller, 
Nicholas Coles, Maximilian Primbs, Erin Buchanan, Patrick S. Forscher

On March 13, 2020, the PSA put out a call for rapid and impactful studies on the psychological aspects of the COVID-19 pandemic. The goal of the call was to initiate the PSA’s COVID-Rapid Project, or PSACR, which would test whether our “big team science” model of massively collaborative psychology could contribute to a psychological understanding of the pandemic.

Now, a year and a quarter later, PSACR is bearing its first fruit. The scope of the project is staggering. According to our project methods, our project produced three core studies, a general health behavior survey, a dataset spanning over 47,000 participants and 44 languages and dialects in 110 countries, with a team of 467 collaborators. Moreover, we produced all these products on a budget of a bit less than $17,000 USD – of which $7,000 was donated by PSA members.

Just as impressive were the hurdles we had to overcome to produce these results. We obtained ethics approval across all our data collection sites, a process that involved huge administrative back-and-forth. We coordinated a translation team of at least 268, who completed forward translation, backward translation, and cultural adjustment processes. We coordinated 18 lab grants and the purchase of 15 semi-representative panels. We maintained two servers for data collection, programmed the project in 44 languages in formr, and completed a massive process of debugging. To maintain quality control, we coordinated a process of internal review before executing the project and revision processes when writing the papers that communicated the results.

We believe that our scientific results justify this massive effort. Our project has produced three highly precise and global tests of questions that are both theoretically and practically important. Moreover, we have produced a huge array of project materials in 44 languages, as well as a massive, meticulously documented dataset ripe for secondary analysis. We hope our three core studies are the first of many scientific contributions that PSACR will produce and inspire.

None of these achievements would have been possible without the PSA’s most valuable resource, its members. PSA members gave freely and generously of their skills and resources to make this project happen. Moreover, given that the author lists for these projects exceed 400, they did so knowing that they might not receive adequate compensation for their effects in the currency that most matters in academia, credit.

We list the main materials of the PSACR project below. Below that, we profile five contributors to this project. We chose these contributors to highlight people from different countries and project roles – and especially some of our many stellar contributors who are early in their careers. Although we do not have space to profile all 467 of our contributors, we hope this does something to make visible some of the many invisible contributions to the PSACR project.

PSACR Project Links

PSACR Study 001 Loss/Gain (preprint currently pre-data; OSF)

A global test of message framing on behavioural intentions, policy support, information seeking, and experienced anxiety during the COVID-19 pandemic

Abstract: The COVID-19 pandemic presents a critical need to identify best practices for communicating health information to the global public. It also provides an opportunity to test theories about risk communication. As part of a larger Psychological Science Accelerator COVID-19 Rapid Project, a global consortium of researchers will experimentally test competing hypotheses regarding the effects of framing messages in terms of losses versus gains. We will examine effects on three primary outcomes: intentions to adhere to policies designed to prevent the spread of COVID-19, opinions about such policies, and the likelihood that participants seek additional policy information. Whereas research on negativity bias and loss aversion predicts that loss-framing will have greater impact, research on encouraging the adoption of protective health behaviour suggests the opposite (i.e., gain-framing will be more persuasive). We will also assess effects on experienced anxiety. Given the potentially low cost and the scalable nature of framing interventions, results could be valuable to health organizations, policymakers, and news sources globally.

PSACR Study 002 Reappraisal (preprint; OSF)

A global test of brief reappraisal interventions on emotions during the COVID-19 pandemic

Abstract: The COVID-19 pandemic has increased negative emotions and decreased positive emotions globally. Left unchecked, these emotional changes might have a wide array of adverse impacts. To reduce negative emotions and increase positive emotions, we tested the effectiveness of reappraisal, an emotion regulation strategy which modifies how one thinks about a situation. Participants from 87 countries/regions (N = 21,644) were randomly assigned to one of two brief reappraisal interventions (reconstrual or repurposing) or one of two control conditions (active or passive). Results revealed that both reappraisal interventions (vs. both control conditions) had consistent effects in reducing negative emotions and increasing positive emotions across different measures. Reconstrual and repurposing had similar effects. Importantly, planned exploratory analyses indicated that reappraisal interventions did not reduce intentions to practice preventive health behaviours. The findings demonstrate the viability of creating scalable, low-cost interventions for use around the world to build resilience during the pandemic and beyond.

PSACR Study 003 Self Determination (preprint currently under revision; OSF)

A Global Experiment on Motivating Social Distancing during the COVID-19 Pandemic

Abstract: Finding communication strategies that can effectively motivate social distancing continues to be a global public health priority during the COVID-19 pandemic as people around the world wait to be vaccinated. This cross-country preregistered experiment (n=25,718 from 89 countries) tested hypotheses concerning generalizable positive and negative outcomes of different motivational messages encouraging social distancing that either promoted personal agency (i.e., autonomy supportive), or pressured people with shaming and blaming tactics (i.e., controlling). Participants were randomly assigned to three conditions: an autonomy-supportive message promoting reflective choices, a controlling message that was restrictive and shaming, or no message, which functioned to capture the real-life communications participants had been receiving. Results partially supported experimental hypotheses: the controlling message elicited more defiance relative to the autonomy-supportive message and increased controlled motivation (engaging in social distancing out of guilt and fear of social consequences) relative to no message, but messages did not influence behavioral intentions. Additionally, motivation to engage in social distancing out of guilt and fear of consequences correlated with more defiance and less long-term behavioral intentions to engage in social distancing, whereas motivation to engage in social distancing out of a true understanding of why the rules are important and necessary yielded the opposite patterns. Overall, this work highlights the potential harm of using shaming and pressuring language in public health communication.

Profiles of PSACR Contributors

Miguel Silan

Miguel Silan is a researcher in the Philippines affiliated with the University of the Philippines Diliman. He is working to organize the local methodological community to adopt the methods reforms and tackle the various issues of the credibility crisis. 

Migs is a long-time contributor to the PSA, first as a member of the Translation and Cultural Diversity committee, and more recently as the new Assistant Director of the Community Building and Network Expansion Committee (CBNEC). With the committee, he has co-organized the monthly PSA coffee hours, Slack engagement threads, the onboarding/welcome channel and is currently organizing a more targeted recruitment of PSA members in world regions that are under-represented in current memberships. With PSA working groups, he is also planning to establish an accessible expertise sharing within the PSA (“The Hub”) and to establish regional support groups that aims to increase culture sensitive and culturally specific research approaches. In the past Migs organized no less than three sessions for PSACON2020 and has been a frequent contributor on topics related to translation and measurement in different cultural contexts. For PSACR, Migs helped lead the development of the health behavior survey that accompanied the three core PSACR studies and was the language-wide coordinator for the Filipino versions of the PSACR project. 

Biljana Gjoneska

Biljana is a Research Associate at the Macedonian Academy of Sciences and Arts. She has a passion for multinational studies and has participated in eight, four of which were PSA projects. Biljana also loves truly global initiatives like the PSA, where she strives to increase the visibility of her beautifully weird and non-WEIRD country (North Macedonia) in the domains of social psychology and social neuroscience.

Biljana is a more recent member of the PSA but has nevertheless been an extremely active contributor. She has participated in numerous PSA-sponsored hack-a-thons, including one on the PSA’s study selection process at PSACON2020. At PSACON2020, she presented a concept for auction of studies, that may help facilitate discussions and decision-making processes for preselection of PSA proposals. Her cumulative experiences with the PSA community inspired her to contribute to the PSA as one of its leaders; she was recently appointed as an Assistant Director on the PSA’s Ethics Committee. For PSACR, Biljana was the language-wide coordinator for Macedonian, for which she managed a team of five to complete the forward translations, backward translations, and cultural adjustments of our three core studies and the health behavior survey. Bilijana also contributed to the coding of location data for the general dataset; these data serve as the basis for the focal inferences in the three core studies.

İlker Dalgar

İlker is an Assistant Professor at Ankara Medipol University. He is also working on co-founding the Turkey Open Science Initiative, which aims to promote open and robust research practices, facilitate big team science, and facilitate discussion of and training related to research issues in Turkey.

İlker has been a long-time contributor to the PSA as an Assistant Director of the Translation and Cultural Diversity Committee. In this role, İlker helped develop the PSA’s translation procedures and standards, which have by now been implemented in nine PSA studies. İlker has also led or assisted with three PSA-themed grant proposals, all focused around increasing the participation from researchers in world regions currently underrepresented in the PSA network. For PSACR, İlker served as the language-wide coordinator for Turkish, managing a team of thirteen to complete forward and backward translations, as well as cultural adjustments, for all three core studies and our health behavior survey.

Maximilian Primbs

Max is finishing his Research Master’s in Behavioural Science. In fall, 2021, Max will begin a PhD at Radboud University, the Netherlands, where he will study situational models of implicit bias.

Even though Max joined the PSACR project very early in his career, he shouldered a huge responsibility as the project’s primary translation coordinator. For a project involving 44 languages, three primary studies, and a health behavior survey, as well as a translation team of at least 268 people, this was an enormous responsibility. The translation procedure was also more involved than is typical for many projects, involving separate forward translation, backward translation, and cultural adjustment stages. Max rose to the occasion, ensuring this massive task got done in a timely way and assisting team members with troubleshooting when issues inevitably arose. This huge responsibility whet Max’s appetite for “big team science”; Max ran for and won a seat as an Assistant Director of the Translation and Cultural Diversity Committee and has helped organize two PSA-themed conference submissions.

Savannah Lewis

Savannah was a long-time research assistant in Chris Chartier’s lab. She has now transitioned into an Assistant Director position at the Ashland University International Collaborative Research Center. She will soon be looking for PhD programs, likely starting in 2022. 

Savannah was among the PSA’s first crop of interns. She has been the invisible glue holding the PSA together, safeguarding the PSA’s transition into a full-fledged organization. She has done everything from organizing the PSA’s first conference, PSACON2020, to running the PSA’s newsletters, to administering PSA004 Accelerated CREP. For the PSACR projects, Savannah assisted with general administration and technical implementation. In these capacities, she helped manage the master spreadsheet that tracked general project progress and the complex web of interlocking spreadsheets and software that transformed the 44 language versions of the PSACR project into 44 functioning formr surveys.

News from the Accelerator- May 2021

Study updates:

  • PSA-002 (Object Orientation) PSA-003 (Gendered Prejudice):  The 002/003 team is happy to report that as of 6/1, we are completing data collection for the project. There are a few labs who are still in the process of finishing up, but we anticipate that all data collection for the project will draw to a close within a week. The lead teams will begin data processing and analysis shortly thereafter.
  • PSA-004 (Accelerated CREP): The leadership team is currently working on data processing, data analysis, and authorship credit tracking.
  • PSA-005 (Stereotype Threat): We are waiting on vaccine distribution to get to a place that allows in-person data collection again. This summer the leadership team will evaluate whether in-person data collection is feasible in Fall 2021.
  • PSA-006 (Trolley Problem): The Stage II submission has received a revise-and-resubmit from Nature Human Behavior.
  • PSA-007 (SPAM-L): SPAML is currently in its beginning stages and recruiting collaborators for a variety of pre-project tasks. More information about these tasks can be found here and here. For more information on this project, please contact buchananlab@gmail.com, Kelly.cuccolo@und.edu, or check out the hackathon hosted by Erin and Savannah.
  • PSA-COVID Rapid Bundle (001/002/003)- 
    • 001: is submitted to PNAS. A preprint will be uploaded in the near future.
    • 002: the revised Stage II manuscript will soon be resubmitted to Nature Human Behavior
    • 003: the proposing authors are currently incorporating feedback from the PSA network.

Webinar 

On June 17th 10-11:30 AM Eastern Pacific, we will be hosting a summer symposium titled “Revisiting the role of demand characteristics in social science research”. More information here. All are welcome! 

CREP Collaborations

Please help us decide on the next Accelerated CREP Study!  

Accelerated CREP is a joint effort between the PSA and the Collaborative Replications and Education Project (osf.io/wfc6u).  You can learn about our first study, PSA 004 True Belief, here: https://psyarxiv.com/zeux9/. We are asking interested PSA members to vote on the next collaboration. More information (and a link to voting) is available here.

PSACON 2021


The preparations for this year’s edition of the PSA conference (PSACON 2021) are underway. We have a fresh new team of PSA members who will serve in their capacity as organizing committee who volunteered to dedicate some of their time to the organization of the event. If you are interested in serving on this committee you are welcome to reach out to any of the following members. The team thus far consists of an amazing group of people in our organization. 

We’ve kept the best parts of PSACON2020! Much like last year, interested individuals can sponsor another attendee’s registration while paying for their own. PSACON2021 will be hosting a wide variety of events, including PSA studies, presentations from our collaborators, hackathons, and coffee hour sessions. As the organizing committee delves into the process of putting out a call for presenters, we hope to welcome increasingly creative ways of talking about science during a virtual conference. More details about the schedule, the format of the conference, and sending in presentations will be sent around mid-June!

As part of our planning for this virtual event, we are asking you to help us in making a joint, informed decision regarding some important organizational aspects. You can do this by filling out this poll. Please make your voice heard, and we hope to see you at this year’s conference!

News from the Accelerator- February 2021

  • Study updates:
    • PSA 002: Object Orientation & PSA 003: Gendered Prejudice- We have now completed trouble shooting for the new online version of the procedure and are ready for any labs who have not yet completed data collection to begin using this new procedure. 
    • PSA 004: Accelerated CREP- 004 is wrapping up data collection at a few sites but are no longer taking any new labs. We’ll be reaching out to contributors in February or March.
    • PSA 005: Stereotype Threat- We’re waiting on vaccine distribution to get to a place that allows in-person data collection again. This summer, we’ll evaluate whether in-person data collection is likely to be feasible in fall 2021.
    • PSA 006: Trolley Problem- This project is coming close to an end as we have submitted the manuscript!
    • PSA 007: SPAM-L- The 007 Canvas Website is ready to go! This means we are going to start rolling out the Pre-projects to members interested in the first week of March. If you would like to contribute to the pre-projects, please email Erin Buchanan (buchananlab@gmail.com).
    • PSA COVID Rapid Bundle (001/002/003)- PSACR 002 and PSACR 003 authors are revising their manuscripts in response to network feedback. PSACR 001 authors are preparing their manuscript for network review.

Partnership with CREP: 

We have decided to partner with CREP again for 2021! We would like you to help us pick our next study to replicate as one big happy network of students and scholars!

Every year CREP selects 1-3 studies to replicate. This year, we’ve narrowed it down to 100 papers from 2018, but we want students to help us with the rest. Students can contribute by going to the link below and following the instructions to rate papers. They can do as many as they’d like between now and March 15!

https://docs.google.com/forms/d/e/1FAIpQLScW8vt-KUlAIbLXQYMPGoai-4LYc-uWbqqwQ9URmF2A8s0A7g/viewform

SO! How can you get involved if you are not a student? Please incorporate this into one of your classes and ask your students for participation. If you would like to know which of your students participates then have them list your information on the form. After March 15, Jordan Wagge will send a list of the students who participate (and how many studies they rate) to any instructors on the list.

Questions? Please email crep.psych@gmail.com.

Thank you

-The CREP & PSA teams

Elections For Director and Associate Director: 

The PSA is currently in the process of electing a new Director and one Associate Director. These positions will be filled by a direct election from the PSA network. PSA leadership has received all of the nominations (self or others) for these roles and we plan to conduct the election process over the next two months. Each nominated individual has until March 15 to write a 1000 word statements to support their candidacy. Shortly after March 15, we will make the candidate statements available in the PSA Slack.  If you have any questions about the election process or what’s involved in the positions, contact Heather Urry, at heather.urry@tufts.edu.

Appointments:

We have 4 new assistant directors appointed. We are very excited to see what each of them will bring to the table. 

Miguel Silan – Assistant Director of Community Building and Network Expansion

Miguel Silan is a psychological science researcher with a focus on meta-methodology (how do we know what we know and why do we do what we do?). He is studying issues in ontology, philosophy of psychometrics and the nature of fuzzy constructs. With the PSA he is scrutinizing the vulnerabilities of cross-cultural studies, and consequently, rethinking the possibilities in how to approach multi-site studies and other large-scale collaborations.

As assistant director for the CBNEC, he plans for the committee to have a more purposive and systematic community expansion approach – especially in recruiting from developing countries and underrepresented world regions. Further, with CBNEC, he is looking forward to implementing a roster of community engagement events (including our beloved coffee socials), as well as community assessment to aid in sustainably applying initiatives from other committees (ex. financial schemes).

Maximilian Primbs – Assistant Director of Translation and Cultural Diversity

Maximilian is a second year Research Master student in Behavioural Science at Radboud University, the Netherlands. After learning about the PSA through an interview he conducted with Chuan-Peng Hu, Max joined the PSA as language-wise coordinator for German for PSA006. After a very positive experience with 006, he decided to work on the PSACR project series and ended up coordinating the translation process for the project. In his term as Assistant Director of Translation and Cultural Diversity he wants to focus on standardising the PSA translation process by creating standard templates and implementation workflows. Moreover, he wants to increase the cultural diversity of the PSA by recruiting students to work on PSA projects. His work outside the PSA is focussed on stereotypes, visual perception, and on the analysis of reaction time data. In his free time, he enjoys fitness, boxing, and playing Dungeon and Dragons (the first two pre-lockdown :wink:).

Biljana Gjoneska – Assistant Director of Ethics

“I discovered the world of PSA, when I first learned about a multinational study investigating morality across the world (PSA 006). The deontological and utilitarian principles explored in different moral dilemmas across many countries, were evocative of medical ethics principles acquired over the course of my undergraduate studies: “primum nil nocere” (i.e., “first, do not harm”) and “primum optime curare” (i.e., “first, secure optimal treatment”). So, I was instantly drawn to the world of PSA.

I discovered the core PSA principles, when I attended the first conference (PSACON). This is where I realized that the topics discussed and the idea I was presenting (about a public auction of proposals) were all grounded on the same principles: scientific rigor and openness to criticism, transparency and decentralized authority, diversity and inclusion. The most humane and most basic ethics was at the root of them all.

I discovered the PSA community, when I was closely collaborating on a chapter about PSA (as promising resource for clinical psychologists). I realized that some moral foundations that I studied over the course of my doctorate studies, like fairness and reciprocity, care and sharing, were the shared characteristics of all my colleagues and PSA members. 

The PSA Ethics Committee comes as a next logical step. I can’t hardly wait to embark on this journey, and I promise to hold all of the mentioned principles and to cherish all people and opinions.” 

Jessica Flake – Assistant Director of Methods

JK Flake has been an active member of the PSA from the beginning. She worked with Chris Chartier and Patrick Forscher to develop a data and methods committee for the PSA and was the methodologist for PSA001. Her work with the data and methods committee has focused on ensuring methodological rigor of PSA studies and making the PSA an avenue for contributing methodological innovations to the field of psychology. Currently she is leading the PSA’s first ever large-scale measurement invariance study and working with the data and methods committee to further our metascience research and support of accepted studies with methodologists.