News from the Accelerator – April 2019

This month we have a few updates on our 6 studies, our search for funding, and other interesting projects that PSA members may be interested in.

001 FACE PERCEPTION

We have collected data from over 9,000 participants! There are two regions that we could still use extra collection in: Africa and Central America & Mexico. If you, or a colleague of yours, would be interested in contributing to data collection in either region, please let us know by replying to this email. Materials are ready, and this would be a relatively quick way to contribute to a PSA study and earn authorship on the Nature Human Behaviour paper! Additionally, we have funds for a few (3-5) small ($200-$400) data collection grants if such an award would make joining possible for you.

001 Preprint

002 OBJECT ORIENTATION & 003 GENDERED PREJUDICE

Labs continue to secure IRB approval and contributors are translating materials into their local languages. The last major step prior to opening data collection for these studies is a pre-registration of the 003 analysis plan, which should be complete in the next few weeks!

002 Preprint

004 TRUE BELIEF

We received a second, and relatively minor, revise and resubmit from Advances in Methods and Practices in Psychological Science. Braeden Hall is leading the revision efforts, and we think we are quite close to securing an in principle acceptance!

004 Preprint

005 STEREOTYPE THREAT

Labs are securing IRB approval, the lead team is finalizing the adaptive design that will be used to distribute participants across conditions, and all collaborators are currently providing feedback on the Stage 1 Registered Report manuscript.

006 TROLLEY PROBLEM

After multiple rounds of contributor feedback, Bence and Balazs submitted the Stage 1 Registered Report manuscript to Nature Human Behaviour. Fingers crossed for a quick and positive peer review experience, and congratulations to all co-authors on making it to this big milestone for the project! Labs are securing IRB approval at a fast rate, and we are just about to begin our translation process in earnest, led by Chuan-Peng Hu, who will be coordinating translations for the study.

006 Preprint

GRANT APPLICATIONS

  • We should hear back on our NSF submission in the next few months. If we receive this grant, we will be able to hire 2 full time research coordinators.
  • The line-up is set for our Synergy grant submission. Hans IJzerman is leading a team including EJ Wagenmakers, Lisa DeBruine, Ben Jones, Denny Borsboom, and John Ioannidis in drafting this submission.
  • Bence Bagó, Balazs Aczel, and Rink Hoekstra are working on a grant application for the NWO replication stream to further expand the 006 study to more non-student samples.
  • Neil Lewis Jr. is leading a team to apply for 005 project specific funding through the William T. Grant Foundation.

INTERESTING OPPORTUNITIES AND PROJECTS SEEKING COLLABORATORS

  • The EEG Many Labs study leaders now welcome study nominations for the project. You can nominate a study using this form.
  • In-Mind Foundation is reorganizing and is seeking Assistant Directors. Here is the interest form.
  • Jess Flake (PSA Data and Methods Assistant Director) is hiring a post-doc in quant psych and modeling. Ad here.

News from the Accelerator – March 2019

March has been a particularly active month for the PSA, and we are building serious momentum collecting data, preparing multiple studies to begin data collection, and establishing new PSA policies around data management and ethics approvals.

The network also continues to grow (556 researchers, 446 laboratories, 65 countries)! Nick Coles is regularly updating this map to reflect our ever-expanding roster of member researchers. If you don’t see yourself or your lab on the map, let us know!

Congratulations and thank yous are in order for Chuan-Peng Hu and Ilker Dalgar who will both be taking up roles as Assistant Directors of the PSA for the Translation and Cultural Diversity Committee. We will be working with Chuan-Peng and Ilker to, among other things, identify translation coordinators for all PSA projects and to further refine and improve our translation procedures. Thank you to Oscar Oviedo Trespalacios who served this role for many months and was integral in creating our initial PSA translation policies!

Study Updates

  • 001 FACE PERCEPTION. We’ve collected data from over 7,000 participants! This study is right on track to wrap up by the planned end of data collection in September.
  • 002 OBJECT ORIENTATION & 003 GENDERED PREJUDICE. Labs are securing IRB approval and contributors are translating materials into their local languages.
  • 004 TRUE BELIEF. Still under review. Fingers crossed!
  • 005 STEREOTYPE THREAT. IRB materials have been drafted and put through a final review with the ethics committee. They will be shared with labs very soon.
  • 006 TROLLEY PROBLEM. Over 80 labs have submitted IRB documents and 40 have approval. We plan to submit the project as a stage 1 registered report to Nature Human Behaviour on April 15th.

 Funding

  • Hans IJzerman is organizing a team to submit a European Research Council Synergy Grant application, and is recruiting researchers who are interested in leading one of the proposed research centers in Europe. You can read more about this opportunity and indicate your interest in getting involved here.
  • We have also started a crowd-funding campaign to pool monthly contributions into small (at first) stipends to support PSA labor that is currently being completed on a volunteer basis. Examples include translation, data management, project management, ethics review (and on and on and on). You can see the ongoing campaign info, and contribute if you are willing and able, at the PSA Patreon page. Thanks to those who have already generously donated, we can begin the process of selecting recipients and paying these stipends next month!

Policy Documents

  • A group led by Patrick Forscher has drafted a very nice and extensive set of data management guidelines for the PSA. This policy document has been voted on and approved by the Data and Methods Committee, but they remain open to your feedback on all things data management and data release. One important element of the guidelines is to identify a data manager for every PSA project. If you are interested in data management, you can check out this tweet thread to learn a bit more and find out how to get involved in a data management role for the PSA.
  • The Ethics Committee is drafting a brief policy document to clarify our plans for documenting situations where labs do not require local ethical approval to conduct a PSA study. You can see the draft policy statement, and the conversation surrounding it in this google doc. Please feel free to provide your feedback in the comments.

Interesting Links and Opportunities

There are several cool posts up on StudySwap seeking collaborators or offering up equipment:

PSA Talks

  • Lisa DeBruine gave a talk about the PSA at the Open Science IMC conference.
  • Braeden Hall gave a talk on both the CREP and the PSA as part of an ECR-led Open Science in Action symposium.
  • Ben Jones gave a talk on the PSA at Abertay University

Thanks for spreading the word!

PSA Facebook

PSA Twitter

News from the Accelerator – February 2019

This month (our 18th month!) we have made progress on PSA policy documents, our search for funding (don’t get too excited…no big news yet), and all 6 of our in-progress studies. Also of note, we’re now up to 428 unique labs! Thank you so much for everyone who has gotten involved in the PSA!

PSA Policies

  • The membership policy was ratified in our most recent vote and is now official PSA policy. This will lead to slight changes in our onboarding process for the PSA generally and specific PSA studies. In the near future we will distribute a one-time form for those already in our membership roster to affirm the code of conduct and the mission of the PSA (be on the lookout for that!).
  • We now call for final comments and votes on our Personnel, Appointments, and Elections Policy Document. PSA members will receive the draft policy via email and have until March 15th, 2019 to vote.

Updates from the Funding Committee

The funding committee has been working extremely hard to identify and pursue promising funding opportunities for the PSA. We all owe a big thanks to Neil Lewis Jr., Thuy-vy Nguyen, and Hans IJzerman for their efforts in organizing our funding search and attempts to date. Here are some notable attempts:

  • We have requested an NSF grant (under review)
  • We requested a Marie Curie grant (but it was rejected 😦 )
  • In the Netherlands, we will collaborate with Marcel van Assen to request an Open Competition Grant
  • Diego Forero is requesting an internal grant at his University to create a PSA hub
  • EU PSA researchers are working on requesting a Synergy Grant. Two centers for this grant have been identified, but we will want to identify two more. Those interested in participating can contact Hans IJzerman.

PSA researchers can identify smaller grant opportunities and contact the funding committee (Neil Lewis and Thuy-Vy Vu) to investigate possibilities. We are always looking for ways to support the PSA and to support PSA members through grants, large and small.

Finally, central to our future funding requests is to work on a long-term vision document, detailing what we are able to accomplish with our current support and capacity, but also what we would plan to do with additional support to make an even bigger impact on psychological science. Chris Chartier is taking the lead on this, and will share drafts in the coming months.

Study Updates

Now that we have 6 studies concurrently in preparation or data collection, some of us are having trouble keeping them straight when discussing their status! So, we’ve started using 3-digit codes and 2-word titles for our in-progress studies. Here are some mini-updates on all 6 PSA studies:

  • 001 FACE PERCEPTION. The study is now up and running, in at least demo mode, for 22 of our data collection languages. You can test out all versions via these demo links. We have now collected data from 3,497 total raters across 9 world regions and are well on our way to meeting our September target for completing data collection!
  • 002 OBJECT ORIENTATION & 003 GENDERED PREJUDICE. These two studies are “bundled” for a shared data collection session. Now that 002 has an in principle acceptance in hand from Psychonomic Bulletin and Review, we have decided to pursue results-blind review (rather than a registered report) for 003. We have initiated IRB and translation processes for these studies in the hopes of initiating data collection quite soon.
  • 004 TRUE BELIEF. We are still in the “revise and resubmit” process for this study at Advances in Methods and Practices in Psychological Science. We hope to have news of an in principle acceptance to share soon!
  • 005 STEREOTYPE THREAT. The leadership team for this study has made considerable recent progress on making final design decisions and we will be sharing IRB materials with data collection labs in the coming weeks.
  • 006 TROLLEY PROBLEM. This study now includes a team of 130 labs across 40 countries! We are hoping to submit as a registered report to Nature Human Behaviour. Our next step is to initiate IRB submission in all data collection labs.

Spreading the Word

Members have presented, or otherwise shared, information about the PSA with wide audiences this month.

  • Hannah Moshontz presented at the SIPS pre-conference session of SPSP in Portland, Oregon. You can see her slides here.
  • Gianni Ribeiro presented to an open science meetup group at IGDORE in Bali.DytUYbBUUAEUOyB
  • Lisa DeBruine gave an excellent interview on the Everything Hertz podcast.
  • Ben Jones published an article on Psychology Today discussing first impressions and how the PSA is working to make the literature less WEIRD.
  • Chris Chartier, Nick Coles, and Hans IJzerman published an article on Science Trends calling for more researchers to join us in building up the PSA.

Interesting Links and Opportunities

Finally, here are some links to other projects or opportunities that PSA members may find interesting (feel free to pass such links along to Chris for future newsletters):

PSA Facebook

PSA Twitter

 

News from the Accelerator – January 2019

It has been an exciting month for the PSA! You can also stay up to date by subscribing to the blog, following us on twitter, signing up for our email list, or joining our slack workspace. For January, we have updates on peer review decisions for our projects, in-progress studies, and new ways to communicate with PSA leadership and stay informed on our activities.

Favorable peer review decisions!

We have just received an in principle acceptance for “Investigating object orientation effects across 14 languages” at Psychonomic Bulletin and Review. Congratulations to Sau-Chin Chen, Anna Szabelska, and all of our co-authors! We will now plan for data collection and share updates soon.

psa_object_langmap_withlogo_110118

We also recently received a favorable revise and resubmit decision for “Accelerated CREP: RRR: Turri, Buckwalter, & Blouw (2015)” at Advances in Methods and Practices in Psychological Science. Braeden Hall and Jordan Wagge have been leading the revision efforts and will resubmit the manuscript soon.

Lab recruitment for moral thinking study

We are recruiting labs for “On the universality of moral thinking: Cross-cultural variation in the influence of personal force and intention in moral dilemma judgments.” The current list of contributing labs is up to 105 sites representing 42 countries! This is a great start, but we still welcome additional labs to join the team. We will likely submit this project as a Registered Report, so the size and diversity of our team will strengthen our Stage 1 submission and chances of securing an in principle acceptance. 

Data collection

Data collection continues for “To which world regions does the valence-dominance model apply.” We have now collected data from over 2,000 participants across 48 labs. More labs and more languages of collection are going “live” every day and we will continue the project through September. You can see demo versions of all active languages here.

Staying up to date on PSA activities

We have started an “on-deck” document that summarizes the various active projects and work of the PSA. If you are wondering what activities could use extra person-power or what the leadership team is working on, this document is a great place to look! We will try to make it more detailed and helpful in the coming days, as well as keep it as up to date as possible.

Chris will be hosting monthly Q&A sessions for PSA members via google hangouts. If you’ve been on the “sidelines”, are not sure how to get more actively involved in the PSA, or have any questions about our policies, processes, or current studies, please join in on an upcoming call to have your questions answered! The times for the meetings will vary considerably from month to month to allow for members from all of our different time zones to have opportunities to join. The first hangout will be Monday, February 25th, 17:00 UTC. You can join the call at this link   (which we will also share via twitter just prior to the meeting).

One last random note: in the PSA members’ roster spreadsheet, we recently switched all lab IDs to 3 digit ISO codes. Lab IDs that were being used for the faces study are being held constant for use in that specific tracking sheet and data collection process, but we will use the new ISO codes going forward.

Thank you for all of the continued efforts you have put into making the PSA a success!

Chris

 

 

News from the Accelerator – December 2018

Starting with this post, the PSA will be releasing monthly updates on the blog to keep everyone, PSA members and interested observers, informed on PSA activities. You can stay up to date by subscribing to the blog, following us on twitter, signing up for our email list, or joining our slack workspace. For December, we have updates on study selection, PSA policy creation, in-progress studies, and activity reports from several of our committees.

A New Study!

On the universality of moral thinking: Cross-cultural variation in the influence of personal force and intention in moral dilemma judgments” as our next official PSA study! This proposal was submitted by Bence Bago (Toulouse School of Economics, France) and Balazs Aczel (Eotvos Lorand University, Hungary). Congratulations! You can read more about in this just-published blog post.

PSA Policies

We are making progress on a wide range of PSA policies. This month, we focus on three:

  • Our code of conduct was approved by vote, and is now official PSA policy. You can read it here.
  • We now call for a vote on our membership policy document. PSA members will receive the draft policy via email and have until January 15th, 2019 to vote.
  • Finally, we welcome feedback on our draft Personnel, Appointments, and Elections Policy Document. Please provide your comments and suggested edits by January 15th, 2019.

Updates on Current Studies

We have 5 studies in various stages of preparation or implementation:

  • The face perception study has been accepted in principle at Nature Human Behaviour, we have translated materials into 19 languages, and data collection has begun in dozens of labs. You can check out a test page of the study in each language here.
  • The object orientation study is under review at Psychonomic Bulletin and Review as a Stage 1 Registered Report.
  • The gendered nature of study is still in the drafting phase as a Stage 1 Registered Report.
  • The Accelerated CREP study is under review at Advances in Methods and Practices in Psychological Science as a Stage 1 Registered Report.
  • The stereotype threat study has recruited 38 data collection labs and is in the planning stage.

Updates from Our Committees

Each month, we will also use the newsletter to highlight updates from at least a few PSA committees in the hopes that all members will have a better sense of ongoing PSA activities they are not directly involved in. This month we have updates from Project Management, Data and Methods, and Ethics.

  • The D&M committee has been very active developing their own set of committee specific policies and procedures. Recently, they have1) voted on and passed the section of the D&M bylaws laying out the formal roles on the D&M committee (i.e., what the Assistant Directors do, what the standing committee members do, what ad-hoc members do)(2) revised our data management policy with an eye toward being compliant with the Psych-DS project. our hope is that PSA can promote Psych-DS and be a testing ground for how well it works. hopefully this can help Psych-DS gain traction to be a discipline-wide standard for psychology datasets

    (3) discussed ways for people to propose meta-science projects through D&M. we’ve put this on the backburner for the time being until we’ve solidified more of our policies

    (4) worked on a formal document to identify the needs of PSA-approved projects

    (5) worked with community building to start building a database of lab-specific meta-data

  • The Project Management Committee has started to manage several ongoing projects and are in the process of making our policies official. Nick Coles and Chris are now project monitors for the face perception study, Hannah Moshontz is the project monitor for the stereotype threat study, and the committee is working to identify individuals interested in taking on a project management role for the object orientation study, the gendered nature of prejudice study, and the trolley problems study! (Email hmoshontz@gmail.com if you are interested!)
  • The Ethics Committee has drafted ethics review guidelines that we will use during the study selection process and will share them with the PSA network for feedback soon. The Ethics Committee has also begun pairing ethics committee members with each PSA study to serve as a dedicated contributor focused on IRB and ethical issues through the full life-cycle of each project.

Wrapping Up 2018

In 2017 we introduced the idea of the PSA, recruited nearly 200 labs to the network, and selected our first studies. In 2018 we built on our initial momentum, made substantial headway formalizing how the PSA works, and made exciting progress on several of our studies. A few highlights include publishing our introductory paper, securing our first in principle acceptance for the face perception study, submitting two more registered reports (still under review :)), selecting 2 new studies, formalizing our leadership team and committee structure, and more than doubling the size of the laboratory network. Thank you for the countless, and at times thankless hours of work that all of you have contributed to make the PSA a success in 2018.

Here’s to an even more productive and exciting 2019 full of Accelerating Psychological Science!

Chris

pasted image 0 (1)