" />
class: center, middle, inverse, title-slide # ReproHack ## <img src='https://github.com/reprohack/reprohack-hq/raw/master/hex/reprohack.png' height=200px><br/>one-day reproducibility hackathons ### <br><br>Anna Krystalli <span><i class="fab fa-twitter faa-float animated "></i>@annakrystalli</span> ### rOpenSci Community Call 2019-07-30 --- layout: true <div class="my-footer"><span>rOpenSci Community Call                             @annakrystalli <a href="https://twitter.com/annakrystalli"><i class="fab fa-twitter"></i> </a> @annakrystalli <a href="https://github.com/annakrystalli"><i class="fab fa-github-alt"></i> </a> </span></div> --- # ReproHack History #### OpenCon Satellite: Berlin, 2016 #### OpenCon Satellite: London, 2017 -- <br> Inspired by Owen Petchey's [Reproducible Research in Ecology, Evolution, Behaviour, and Environmental Studies](https://github.com/opetchey/RREEBES) course, - Reproduce published results from raw data - Over a few months and a number of sessions -- ### **ReproHack mission: Reproduce paper in a day from code and data** --- # SSI Fellowship .pull-left[  ] -- .pull-right[   ] --- class: inverse, left, bottom # .font_title[How does it work?] *** --- # Call for papers .pull-left[ <blockquote class="twitter-tweet"><p lang="en" dir="ltr">✨Do you champion <a href="https://twitter.com/hashtag/reproducible?src=hash&ref_src=twsrc%5Etfw">#reproducible</a> <a href="https://twitter.com/hashtag/research?src=hash&ref_src=twsrc%5Etfw">#research</a>? <br>✨Do you have a reproducible paper with open code and data?<br><br>The <a href="https://twitter.com/SoftwareSaved?ref_src=twsrc%5Etfw">@SoftwareSaved</a> <a href="https://twitter.com/hashtag/ReproHack?src=hash&ref_src=twsrc%5Etfw">#ReproHack</a> series needs you! 🚀<br><br>Help others learn & engage with your work by submitting it to our 1-day Reproducibility hackathons!<a href="https://t.co/PssdXqwl8Z">https://t.co/PssdXqwl8Z</a></p>— annakrystalli (@annakrystalli) <a href="https://twitter.com/annakrystalli/status/1138769695513952260?ref_src=twsrc%5Etfw">June 12, 2019</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> ] -- .pull-right[  ] --- # On the day - #### Review and select papers for reproduction - #### Work with materials and reproduce - #### Discuss - #### Feed back to authors  --- class: inverse, bottom, left # .font_title[Benefits] *** --- # Participants .pull-left[ 1. #### Practical reproducibility they can implement in their own work ] .pull-right[  ] --- # Participants .pull-left[ 1. #### Practical reproducibility they can implement in their own work ] .pull-right[  ] --- # Participants .pull-left[ 1. Practical reproducibility they can implement in their own work 2. #### Inspiration from working with other people’s code and data. ] .pull-right[  ] --- # Participants .pull-left[ 1. Practical reproducibility they can implement in their own work 2. Inspiration from working with other people’s code and data. 3. #### Reproduction as community value ] .pull-right[  ] --- # Authors .pull-left[ 1. #### Useful feedback on the reproducibility of their work ] .pull-right[  ] --- # Authors .pull-left[ 1. Useful feedback on the reproducibility of their work 2. #### Appreciation for their efforts in making their work reproducible ] .pull-right[  ] --- # Authors .pull-left[ 1. Useful feedback on the reproducibility of their work 2. #### Appreciation for their efforts in making their work reproducible ] .pull-right[  ] --- # Authors .pull-left[ 1. Useful feedback on the reproducibility of their work 2. Appreciation for their efforts in making their work reproducible 3. #### An opportunity to engage others with their research. ] .pull-right[  ] --- class: inverse, left, bottom # .font_title[Some lessons] *** --- # Reproducing papers is fun!! .pull-left[  ] --- # Reproducing papers is fun!! .pull-left[ <blockquote class="twitter-tweet"><p lang="en" dir="ltr">Huge thanks to <a href="https://twitter.com/EnviroKaty?ref_src=twsrc%5Etfw">@EnviroKaty</a> for submitting a fab 🦋 🦋🦋 paper to the <a href="https://twitter.com/hashtag/CCMcr19?src=hash&ref_src=twsrc%5Etfw">#CCMcr19</a> <a href="https://twitter.com/hashtag/ReproHack?src=hash&ref_src=twsrc%5Etfw">#ReproHack</a>! I had loads of fun reproducing the analysis for this really cool paper <a href="https://t.co/v1ww2D5xhg">https://t.co/v1ww2D5xhg</a> <a href="https://t.co/r8rYMAMvPm">pic.twitter.com/r8rYMAMvPm</a></p>— Jessica Ward (@JKRWard) <a href="https://twitter.com/JKRWard/status/1144254546841165827?ref_src=twsrc%5Etfw">June 27, 2019</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> ] .pull-right[ <blockquote class="twitter-tweet"><p lang="en" dir="ltr">Many thanks to <a href="https://twitter.com/annakrystalli?ref_src=twsrc%5Etfw">@annakrystalli</a> for a brilliant <a href="https://twitter.com/hashtag/ReproHack?src=hash&ref_src=twsrc%5Etfw">#ReproHack</a> at <a href="https://twitter.com/hashtag/CCMcr19?src=hash&ref_src=twsrc%5Etfw">#CCMcr19</a> today - and mega thanks to <a href="https://twitter.com/Ben_C_J?ref_src=twsrc%5Etfw">@Ben_C_J</a> for nominating one of his papers with <a href="https://twitter.com/LisaDeBruine?ref_src=twsrc%5Etfw">@LisaDeBruine</a> and colleagues to see if we could reproduce the modelling results - and we could! 💯 😀👍 <a href="https://twitter.com/hashtag/opencode?src=hash&ref_src=twsrc%5Etfw">#opencode</a> <a href="https://twitter.com/hashtag/opendata?src=hash&ref_src=twsrc%5Etfw">#opendata</a> ftw!</p>— Andrew Stewart (@ajstewart_lang) <a href="https://twitter.com/ajstewart_lang/status/1144316430063677446?ref_src=twsrc%5Etfw">June 27, 2019</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> ] --- background-image: url("assets/storytelling-inv.jpg") # People love stories ...i.e. literate programming .pull-left[ > Awesome work, I had a lot of fun reproducing the analysis and investigating the paper. I'm now looking forward to playing around with the code for wrangling inaturalist data!! > --- Jessica Ward on _["Comparisons of Citizen Science Data-Gathering Approaches to Evaluate Urban Butterfly Diversity"](https://www.mdpi.com/2075-4450/9/4/186)_ submitted by Kathleen Prudic ] .pull-right[ > It was great working with someone else's markdown script - the .Rmd file itself was written in a really clear and transparent manner with lots of helpful comments and signposting as to what each chunk of analysis did. > --- Andrew Stewart on _["Comparing theory-driven and data-driven attractiveness models using images of real women’s faces"](https://psyarxiv.com/vhc5k)_ submitted by Ben Jones ] --- class: inverse, left, bottom # .font_title[Future Development] *** --- # A growing team! .image_profile[] ### [Florencia D'Andrea](https://rladies.org/argentina-rladies/name/maria-dandrea/) Postdoc at the National Agricultural Technology Institute of Argentina --- # Reproducible Reprohacks .pull-left[ #### Current setup - paper list compiled in shiny app - Google forms to submit papers & author feedback - GitHub repo to run event <br> [reprohack/reprohack-template-shiny](https://github.com/reprohack/reprohack-template-shiny)|[instructions](https://github.com/reprohack/reprohack-hq/blob/master/organiser_instructions.md) ] -- .pull-right[ #### Next Generation setup - All through GitHub - Submit papers through pull requests - Track Reproductions through issues .image_profile[ <img src="assets/Radovan-Bast.jpeg" height=150px width=150px/> ] ##### [Radovan Bast](https://bast.fr/) University of Tromsø/Code Refinery See [issue #10](https://github.com/reprohack/reprohack-hq/issues/10) ] --- # Many ways to ReproHack <img src="https://github.com/reprohack/reprohack-hq/blob/master/assets/workflow.png?raw=true" width=700px /> --- # ReproHack outputs: [ReScience C](http://rescience.github.io/) .pull-left[ #### Replication Report - Repeat a published protocol - Respect its spirit and intentions - Varying the technical details, e.g. using different software, initial conditions, etc. 👉 **Change something that everyone believes shouldn’t matter, and see if the scientific conclusions are affected** ] .pull-right[  ] --- # ReproHack outputs: [ReScience C](http://rescience.github.io/) .pull-left[ #### Replication Report - Repeat a published protocol - Respect its spirit and intentions - Varying the technical details, e.g. using different software, initial conditions, etc. 👉 **Change something that everyone believes shouldn’t matter, and see if the scientific conclusions are affected** ] .pull-right[ #### Reproducibility Report - How easy/hard it was to re-run everything, - If the same results as the ones published were obtained, - If different architectures were used, etc. - What else? ] --- # ReproHack outputs: [SciGen.Report](https://scigen.report/) Check Reproducibility status of a paper  --- # ReproHack outputs: [SciGen.Report](https://scigen.report/) Short Reproducibility status report  For more details see [issue #6](https://github.com/reprohack/reprohack-hq/issues/6) --- # Get involved! ### [reprohack-hq](https://github.com/reprohack/reprohack-hq) repository #### Check out our [issues](https://github.com/reprohack/reprohack-hq/issues) #### Chat to us: [](https://gitter.im/reprohack/community?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge) #### Sign up to our Newsletter <form style="border:1px solid #ccc;padding:3px;text-align:center;" action="https://tinyletter.com/reprohack-hq" method="post" target="popupwindow" onsubmit="window.open('https://tinyletter.com/reprohack-hq', 'popupwindow', 'scrollbars=yes,width=800,height=600');return true"><p><label for="tlemail">Enter your email address</label></p><p><input type="text" style="width:140px" name="email" id="tlemail" /></p><input type="hidden" value="1" name="embed"/><input type="submit" value="Subscribe" /><p><a href="https://tinyletter.com" target="_blank">powered by TinyLetter</a></p></form>