News from the Accelerator- July 2020

July has been extremely active in the PSA, and this newsletter contains updates on many projects, but we’d like to highlight two things up front:

First, the PSA has taken a very big and important step as an organization this month by initiating our first truly democratic election for an open Associate Director position! You can read the candidates’ statements at the links below to prepare for the vote.

Second, we are continuing data collection on the PSA-Covid-Rapid studies as long as we can afford to, which is likely through the end of August. The team could use some more data collection help to make sure we clear our pre-registered N targets!  Email psacovid@gmail.com if you are interested in joining or have questions about joining.

Election

The two candidates in our election for an open Associate Director position, Peter Mallik and John Protzko, have provided written statements describing why they’ve chosen to run, and describing what they’d like to achieve in the Associate Director role if elected. 

You can read each statement by clicking the candidate’s name here: Mallik and Protzko. Additionally, we have posted each statement in dedicated slack channels. I encourage all members to read them, consider them carefully, and ask any questions you have for the candidates! You can ask questions by joining the PSA slack workspace at this link, and then joining the #associatedirectorelection_protzko and #associatedirectorelection_mallik channels. The slack discussion closes today, but you can read the questions and answers throughout the election. Soon, we will email each PSA member with instructions about how to vote.

Conference

Approximately ⅔ of the available seats are full, so make sure to register now to claim your spot if you’d like to attend. We have a recent surge of attendees requesting free admission, and would very much like to to be able to fill all requests, so we would be very grateful if a few additional members were able and willing to pay the $60 admission fee to open up more free spots. Also, the program is  slowly but surely filling up. If you have work or ideas you would like to present at the conference be sure to fill out of new submission form! We’ve started a general info page that highlights a few presentations already set and links out to the current draft program. We hope to have the full program set in late August and will share an update with the full network when it is ready to go!

Current Studies

  • PSA 001- The Stage 2 Registered Report has been resubmitted to Nature Human Behaviour. Now we are waiting for the final decision from the editor.
  • PSA 002/003- The 002 and 003 teams are in the final stages of moving our experiments from Open Sesame/Qualtrics to Lab.JS. Thanks to the hard work of Merle Schuckart, we have drafts of the new programs and are in the process of ensuring that the web versions of the studies retain fidelity to the original protocols and troubleshooting the studies. The new version of the experiment should fully integrate both the 002 and 003 procedures into one online protocol, greatly simplifying future data collection.
  • PSA 004- Data collection has slowed down as many members’ universities have concluded their semesters. We do however need more CREP reviewers as we wrap up this project at the end of the year. CREP reviewers look over each lab’s OSF page to ensure that each lab is performing the study as planned. If you or someone else is interested please have them fill out this form.
  • PSA 005- 005 is waiting on a decision on our Stage 1 submission at Nature Human Behaviour.
  • PSA 006- 006 is continuing data collection and is slated to finish sometime between October and December. We continue to have new labs join and are extremely excited to finish up this year!
  • PSACR 001/002/003- The PSACR bundle is still collecting data. We now have over 19,000 participants (i.e., people who have completed the general questions about the pandemic and participated in one or more of the study surveys). The survey is offered in 38 (!!) languages and dialects, with a handful more to be implemented very soon. We are still planning to collect data as long as we can afford to, which we expect to be through August. We are also welcoming new labs to join data collection if they use one of the languages we’ve translated already (see here for a list of implemented and soon-to-be implemented languages http://formr.psysciacc.org/shiny/shiny_app/) . Email psacovid@gmail.com if you are interested in joining or have questions about joining.

A Chapter on the PSA, QRPS, and Clinical Psych

A group of PSA members, led by Julie Beshears, are beginning work on an invited chapter about the PSA and how the PSA’s design can affect the presence of questionable research practices (QRPs) in clinical psychology research.  Ideally, they are seeking individuals with clinical experience, but other contributions are welcome.  If this project interests you, you may join the slack channel (proj_clinical_chapter) or email Julie at jebeshears@eagles.usi.edu.

Committee Updates

  • Ethics committee- We would like to congratulate our newest Assistant Director of the ethics committee!! Mike Mensink was just appointed the position last week and seems very eager to start in his new position. Welcome Mike and we look forward to collaborating with you soon!
  • Translation and Cultural Diversity Committee- The Translation and Cultural Diversity Committee (TCDC) would like to collect data on the translation capacity of the PSA for future projects: in which countries and for which languages do we have adequate potential translators? This knowledge will help us to determine our potential capacity, or lack-there-of, in many possible data collection languages, and thus make better plans for future projects. Please answer this very short, 1-minute survey, to help us. Thank you!!
  • Project monitoring Committee- The member website is receiving an update soon. A big shout out to the fantastic Erin Buchanan for helping the team find a way to manage projects through Canvas. Erin will be going over this update and much more at the conference in September, so make sure you check that out for more information!

Recorded for the Chinese Open Science Network Available Online 

Chris Chartier recently gave a talk to the Chinese Open Science Network. They recorded the presentations and have posted it here, so anyone can watch and reach out with any questions or feedback (cchartie@ashland.edu). 

Thank you for all that you have, and continue to do, on behalf of the PSA. Onward!

Savannah and Chris

News from the Accelerator- June 2020

Hello all you amazingly talented and dedicated Accelerators! We’ve made some really tremendous progress in June, and this newsletter will provide updates on PSA personnel, the upcoming PSA conference, all of our current studies and more.

Research Coordinator

Thanks to seed funding from Ashland University and some personal donations from PSA leadership, the PSA has hired Savannah Lewis to serve as Research Coordinator. She will help to organize our conference (see below), provide administrative support for all of our studies, and fundraise to better support our members. Some of you have already worked with Savannah on Slack or Zoom and can attest to how lucky we are to have her working on the PSA (Chris speaking here :)! Shoot her a Slack DM to welcome her and connect on any initiatives or projects you’d like help with.


Translation Capacity Assessment

The Translation and Cultural Diversity Committee (TCDC) wants to assess the translation capacity of the PSA: across many possible languages of translation, how many potential translators do we have? This knowledge will help us to determine our potential availability and scarcity in languages, and thus make better plans in future projects. Please answer this very short, 1-minute survey, to help us.

Conference

We are now in the process of lining up specific sessions, moderators, and presenters for the conference. As of right now we have 120 confirmed attendees (with a cap of 300)! This means we still have spots open if you have not yet registered, which you can do here. We have also started distributing receipts to all registered attendees who were able to pay the $60 fee (thank you, your payment also created 2 free spots for others at the conference). Please be on the lookout for those receipts in your inbox, and let us know if you need any additional documentation to facilitate reimbursement from your institution. 

SIPS 

Several members gave a really nice presentation about the PSA as an “unconference” session at SIPS. Thanks to Erin Buchanan, Jordan Wagge, Max Primbs, Crystal N. Steltenpohl, and Jeremy Miller for representing us there. The session was recorded, so we also now have an overview video link that we can share with folks who are curious about the PSA. Feel free to pass it along to colleagues! 

Current Studies

  • PSA 001- The Stage 2 Registered Report has been resubmitted to Nature Human Behaviour. Now we are waiting for the final decision from the editor.
  • PSA 002/003- Thanks to the amazing collaboration between Merle Shuckart, Alessandra Souza, and Erin Buchanan we have been able to start getting this study bundle online. If your lab is going to be running the study online, each lab will need to provide an information text to participants signing up explaining the goals, risk, etc. 
  • PSA 004- Data collection has slowed down as many members’ universities have concluded their semesters. We do however need more CREP reviewers as we wrap up this project at the end of the year. CREP reviewers look over each lab’s OSF page to ensure that each lab is performing the study as planned. If you or someone else is interested please have them fill out this form.
  • PSA 005- The PSA005 team completed its feasibility pilot of the technical implementation of the study. The leadership team then finished its revision to the manuscript and resubmitted this revision to Nature Human Behaviour! COVID-19 has disrupted the data collection timeline, but the leadership has decided to monitor the situation at the start of each semester to determine the safety and feasibility of in-person data collection.
  • PSA 006- The PSA 006 project is currently collecting data. So far, the ~150 participating labs have collected data over 8, 000 participants. Following the registered plan, the team is conducting sequential data analyses in three cultural clusters. Further rounds of data collection are expected later this year.
  • PSACR 001/002/003- The PSACR bundle is collecting data in 19 languages, and the data collection deadline has been extended through mid-July or longer (we will continue collecting data as long as we can afford to). We are collecting data through PSA member labs and also through several panels. Over 10,000 people have participated so far, meaning that they completed the general questions about the pandemic and one or more of the study surveys. 

Thank you for all that you have, and continue to do, on behalf of the PSA. Let’s keep accelerating psychological science together!

-Chris and Savannah

News from the Accelerator – May 2020

This month, we have updates on myriad fronts, including but not limited to, a spike in new PSA membership sign-ups, progress on studies PSA 001 through PSA 006, information about our recently launched PSA Covid Rapid Studies, a call for new members on two PSA working groups, and several interesting opportunities to collaborate with other PSA members on research projects.

MEMBERSHIP

Our network has officially grown to over 1, 000 members. Welcome new accelerators!! We have no doubts that you will do great things in our network. Just in the last couple months since our last newsletter, we have added hundreds of members. We are stoked to see our network continue to grow.

STUDY UPDATES

  • PSA 001- The Stage 2 Registered Report received a revise-and-resubmit from Nature Human Behaviour. The lead authors have made the requested changes, and the participating labs are currently reviewing the updated manuscript. After the lead authors address those comments, they will resubmit the manuscript.
  • PSA 002/003- As a result of the pandemic, face-to-face data collection for the 002/003 bundle has been suspended until further notice. We are currently testing the feasibility of moving the procedure online, in case there are no opportunities for in-person data collection for the remainder of the year. Our goal is to complete data collection and submit 002’s Stage 2 registered report by the end of 2020. Thus far, we have collected data from 2,560 participants across 16 languages!
  • PSA 004- The Accelerated CREP originally should have been ending data collection right about now, but has been extended through the end of 2020 because of Coronavirus-related delays. You can still join the project to collect data (onboarding form here)! All data collection can happen online.
  • PSA 005- The lead team is working on finishing up its revisions of the Stage 1 Registered Report. Our editor at Nature Human Behaviour asked us to do some pilot testing of our technical implementation of the adaptive algorithm that governs condition assignment. With Erin Buchanan’s help, we implemented all aspects of the project in formr and conducted a variety of tests to ensure that the condition assignment changes as appropriate in light of different kinds of evidence. This whole effort went slower than expected due to the outbreak of the coronavirus, but we received an extension from our editor. We’ve also finished a first draft of our paper revisions and our response to reviewers. We expect to submit the revision within 1-2 weeks.
  • PSA 006- The PSA 006 project is currently collecting data. So far, the ~150 participating labs have collected data from 8,450 participants. Following the registered plan, the team is conducting sequential data analyses in three cultural clusters. Further rounds of data collection are expected later this year.
  • PSACR 1/2/3- PSA Covid Rapid (PSACR) is three bundled studies running together along with some general questions. PSACR 001 and 003 will be submitted for publication after data collection is complete. PSACR 002 was accepted as a Stage 1 Registered Report at Nature Human Behavior. Data collection is live for all three studies in English, Hungarian, and Dutch and many more languages are in the translation and implementation pipeline. Over 5,000 people have participated so far. Many people have been working hard to pull off this project and in particular, Heather Urry, Max Primbs, and Erin Buchanan have done tremendous work to keep the project afloat, catch errors, and help move translation and implementation along.
  • Upcoming New Studies- Resulting  from our 2019 call for studies, 1 proposal has been accepted pending minor revisions, two are being revised and resubmitted with possible acceptance in 2020, and several more are being revised and resubmitted in preparation for future calls for studies.

PSA SERVER PURCHASED

Thanks to a generous donation from Erin Buchanan, we were able to purchase new server equipment to support the increasing complexity and data collection load of our current and future PSA studies! The new server has been blazing fast in our initial tests, and it should be ready for us to start using in earnest soon. This also means we are going to be able to overhaul our  member website to give it a functioning dashboard that will be more effective and user-friendly for members.

PLANNING THE PSA’S FIRST CONFERENCE

We are hoping to host a virtual meeting in 2020 and are exploring possible dates. Our preliminary plan is to hold the conference in September (on the 1st, 2nd, and 3rd, or on 8th, 9th, and 10th) with sessions spreading across 12 hour each days to help accommodate the vast time zone differences of PSA members. We are hoping to get feedback on which set of days works best for our members (starting on the 1st of September or starting on the 8th of September). We are planning to have a range of session types, including update presentations on current PSA studies, workshops on how to get involved in our studies, study submission tips, as well as presentations on non-PSA research that our members are currently working on. We hope to have further details for y’all soon. Please reach out to slewis16@ashland.edu to give feedback on preferred dates or if you would like to be added to our email list of possible attendees.

DATA AND METHODS COMMITTEE SEEKS NEW MEMBERS

The PSA Data and Methods Committee is seeking a new standing member of our committee. The Data and Methods Committee (DM) is responsible for operation and policy development related to methodology, meta-science, and data management within the PSA. Those interested to join the committee should read our bylaws here: https://osf.io/p65qe/. This position is a two-year commitment, starting in June 2020, with the following responsibilities:

  • Attend bi-weekly Data and Methods committee meetings
  • Assist with the committee’s operation and research responsibilities
  • Advise on matters of committee policy
  • Vote on research projects and amendments to the committee’s bylaws
  • Fulfill assigned responsibilities (as delegated by the Assistant Directors)

Some examples of recent work carried out by the committee are:

  • Writing, revising, and ratifying the analysis plan approval process
  • Coordinating with the larger PSA leadership to develop a needs assessment
  • Selecting methodological reviewers for proposals
  • Recruiting methodologists and data managers for accepted projects
  • Developing a metascience study submission process
  • Conducting and contributing to DM research projects undertaken by DM members

We expect Standing Committee Members will devote approximately 8-16 hours per month of time to their work. These are not set limits and may fluctuate from month to month. Any members of the PSA are eligible to apply. Previous service experience with the PSA is desired but not required. Application materials to submit:

  1. Statement of interest outlining interest in working with the DM and relevant experience (short; max 500 words)
  2. Relevant documentation that supports the information described in the statement of interest and experience (can be a CV, a personal website, blog, osf page, etc.)
  3. E.g., If you describe experience managing open data you might want to put on your CV links to OSF pages, or link to a github or blog, that is ok — submit a CV or other document that provides background for your experience

Applicants who move on to the next step of recruitment will be asked to attend a DM committee meeting so that they can become acquainted with our process and procedures. Review of applications to begin within one week, review rolling until position is filled.  Please send application materials to: dataandmethods@gmail.com.

PSA METASCIENCE SUBCOMMITTEE SEEKS NEW MEMBERS

The PSA Metascience subcommittee is looking for up to 5 new members to help facilitate Metascience research projects within the PSA.  The role of the subcommittee will be to review proposals on work that uses the PSA to research the process of science, as well as develop policy to support metascience research. Responsibilities of subcommittee members will include reviewing proposals, interfacing with members of the Study Selection, Data and Methods, and Data Management Committees when appropriate, and meeting monthly as a group to review progress.

If you’re interested, send your information to Nick Fox: nfox423@gmail.com by Friday May 29th.  Include a short paragraph on why you’d like to join the subcommittee, what you’re looking to get out of being a subcommittee member, and any metascience or methodological research experience you’ve had (it’s not required, but will be helpful for us to try and maximize the diversity of experiences!). 

OTHER OPPORTUNITIES TO COLLABORATE WITH PSA MEMBERS

African Many Labs

  • We are starting the ManyLabs: Africa project, which is a doctoral thesis on the replicability and generalizability of effects across African and Western populations. The project is led by Adeyemi Adetula, currently at Université Grenoble Alpes (France). The project is supervised by Drs. Hans IJzerman, Dana Basnight- Brown and Patrick Forscher

    We call for researchers from Africa to serve as collaborators in a pilot study (using the CREP framework for a one-study project) and researchers from Africa, Europe, and North America for the main study (ManyLabs: Africa). As part of this project, we will provide online training / webinar courses on open science access and tools to African researchers. 

    Collaborators can earn authorship for data collection, translation, and coordination of their research unit. Other activities could include consultation on study/effects nomination and evaluation.

    Interested researchers can sign up here. For further information, please contact Adeyemi Adetula at adeyemiadetula1@gmail.com.

Two Opportunities from Balazs Aczel: 

  • Balazs Aczel’s lab advertises a collaboration opportunity to find out why people violate lock down. Join the project if you can organize online data collection in your country to extend the multinational datasets. Collaborators are expected to collect data (min 350 pps) from a country with some level of current lock down. More info:  https://tinyurl.com/ConfinementNonadherence
  • Research on how you cope with home-office

Our team would like to explore how researchers cope with working from home now and in general. This is a great opportunity for the research community to change old routines and optimize the time they spend in the office and work from home.

From our survey results, we will create recommendations for institutions on how to support researchers’ efficiency and work-life balance regarding their options and condition in remote working. After responding, you can sign up to win a 100 USD Amazon (or your choice) voucher. If your region was in recent lockdown, please share your experience with home-office in this ~4-min anonymous survey. Follow this link to the Survey.

We appreciate it if you share this survey with your colleagues. Thank you for your support.

Balazs Aczel, ELTE, Hungary

Join the PSA’s Rapid-Response COVID-19 Project

The world is currently witnessing a public health crisis that is unprecedented in our lifetimes: the global COVID-19 pandemic. At the Psychological Science Accelerator (PSA), we are deeply concerned about the many impacts of this outbreak, but we are also optimistic about behavioral science’s potential to mitigate these impacts. With our network of more than 500 labs from over 70 countries, we believe that – with your help – the PSA can play a crucial role in this process. This can only occur if our member labs, and new labs who would like to join us, contribute to project administration and local data collection.

Last week, we put out a call for rapid and impactful studies to understand the behavioral and psychological aspects of the COVID-19 outbreak. We received an overwhelming response. The community submitted a whopping 66 (!!) proposals. 141 PSA members voted on the 11 proposals that passed triage. Yesterday, we provisionally accepted the three proposals that received the most votes, with another four proposals on our “waitlist.” Waitlisted studies will come off the waitlist if we receive an overwhelming response during lab recruitment and if early preparation for our first three studies goes smoothly.

We anticipate that all PSA COVID-Rapid studies will be bundled into a single data collection effort. You can read more details about the selected studies and the process of contributing to data collection here.

We need your help. This project is big. We aim to recruit thousands of participants from all over the globe. We can only succeed with this aim through the collective energy of our members.

You can contribute your time and expertise. One way to help is by joining the COVID-Rapid project. After joining, you can volunteer to manage the projects, translate the project materials into one of over 50 languages, or help with data collection by recruiting online participants from your local community. If you have questions about the process of joining the study, contact the PSA COVID-19 Gmail account at psacovid@gmail.com.

To join this project:

  1. Become a member of the PSA by registering at the member website 
  2. Log in to the member website 
  3. Click on My Lab > Study Sign Up
  4. Complete your member profile at My Account > Create Profile

If you wish to recruit participants for the project, you must be willing to do so fast. This will require very fast ethics approval and data collection. We anticipate that most sites will either join an existing IRB application as an investigator (e.g., the application at Chris Chartier’s Ashland University), ask their local IRBs to defer to an IRB that has granted us approval, obtain an ethics waiver because the study is minimal risk, or go through expedited review. We will work with you on the ethics process once you join the project. 

You can also contribute financially. To pull off a project of this magnitude, we also need financial contributions. For those who can, you can donate via PayPal. Every dollar received will be spent supporting this project. Financial contributions will be used to pay participants, aid with recruitment, compensate translators, and compensate other administrative contributors.

The PSA has an opportunity to activate our global network to confront the global challenge of COVID-19. We will only succeed with your support and involvement. Together, we can harness the potential of behavioral science to further the public good.

Support the PSA COVID-19 Rapid and Impactful Studies with a Donation

DONATE HERE

In response to the rapidly evolving COVID-19 pandemic, the Psychological Science Accelerator (PSA) issued a call on March 13th for rapid and impactful proposals to understand the psychological and behavioral aspects of the pandemic. The response to our call has been both enthusiastic and heartwarming — we received over 60 submissions within the four-day window.

The Psychological Science Accelerator is the largest research network of researchers in the social sciences. We now have over 500 labs from over 77 countries. This network includes the top scientists in psychology, with expertise on study design, data analysis, ethics, study management, and translation. Researchers from all over the entire world submit their study proposals to this network. We strongly believe our combined resources can make an impact in this humanitarian crisis. 

Capture

We are working quickly to select the very best proposals from the 60+ submissions that we received. Based on our current pool, the topics of our COVID-19 studies could range from behavioral interventions to improve adherence to preventive health measures, to interventions to fight fake news about COVID-19, to methods to reduce the anxiety that accompanies social distancing. We are confident that our COVID-19 initiative will make an impact. However, the initiative would be all the more impactful if we had more financial resources at our disposal. These financial resources would allow us to:

  • Pay for participant compensation at sites without large research budgets
  • Use recruitment methods in some sites that do not rely on convenience sampling
  • Pay for social media advertising to assist with recruitment efforts
  • Provide stipends to translators so that our projects can be conducted in non-English languages
  • Provide a stipend for a project manager who could ensure the full project happens on a rapid timetable

In short, financial resources would allow us to have an even greater chance to generate informative research papers and datasets. Because we plan to share these datasets and papers freely and openly, these research products should allow us to substantially improve our knowledge of the behavioral science of COVID-19, thereby contributing to policy discussions about how to mitigate COVID-19’s pernicious public health effects. If you would like to help us in this endeavor, you can contribute to our financial resources via our PayPal.

The community response to COVID-19 has been extremely gratifying. Let’s use our collective skills and resources to understand and respond to this evolving crisis.