November additions to the ASCL

Twenty-three codes were added in November 2017:

BayesVP: Full Bayesian Voigt profile fitting
Bifrost: Stream processing framework for high-throughput applications
clustep: Initial conditions for galaxy cluster halo simulations
correlcalc: Two-point correlation function from redshift surveys
FATS: Feature Analysis for Time Series

FTbg: Background removal using Fourier Transform
galkin: Milky Way rotation curve data handler
galstep: Initial conditions for spiral galaxy simulations
galstreams: Milky Way streams footprint library and toolkit
Gammapy: Python toolbox for gamma-ray astronomy

HBT: Hierarchical Bound-Tracing
HBT+: Subhalo finder and merger tree builder
HO-CHUNK: Radiation Transfer code
inhomog: Raychaudhuri integration
LExTeS: Link Extraction and Testing Suite

Lightning: SED Fitting Package
MARXS: Multi-Architecture Raytrace Xray mission Simulator
megaman: Manifold Learning for Millions of Points
rac-2d: Thermo-chemical for modeling water vapor formation in protoplanetary disks
RGW: Affine-invariant Markov Chain Monte Carlo sampling

SpcAudace: Spectroscopic processing and analysis package of Audela software
SPIDERMAN: Fast code to simulate secondary transits and phase curves
Thindisk: Protoplanetary disk toy model

October additions to the ASCL

Twenty-five codes were added in October 2017:

ATLAS9: Model atmosphere program with opacity distribution functions
Binary: Accretion disk evolution
CppTransport: Two- and three-point function transport framework for inflationary cosmology
EXOFASTv2: Generalized publication-quality exoplanet modeling code
FITSFH: Star Formation Histories

FLaapLUC: Fermi-LAT automatic aperture photometry light curve
FLAG: Exact Fourier-Laguerre transform on the ball
FSFE: Fake Spectra Flux Extractor
galario: Gpu Accelerated Library for Analyzing Radio Interferometer Observations
GASOLINE: Smoothed Particle Hydrodynamics (SPH) code

GBART: Determination of the orbital elements of spectroscopic binaries
GMCALab: Generalized Morphological Component Analysis
LGMCA: Local-Generalized Morphological Component Analysis
LIMEPY: Lowered Isothermal Model Explorer in PYthon
MOSFiT: Modular Open-Source Fitter for Transients

mTransport: Two-point-correlation function calculator
OSIRIS Toolbox: OH-Suppressing InfraRed Imaging Spectrograph pipeline
pred_loggs: Predicting individual galaxy G/S probability distributions
PSPLINE: Princeton Spline and Hermite cubic interpolation routines
PyTransport: Calculate inflationary correlation functions

Ramses-GPU: Second order MUSCL-Handcock finite volume fluid solver
rfpipe: Radio interferometric transient search pipeline
SkyNet: Modular nuclear reaction network library
SPIPS: Spectro-Photo-Interferometry of Pulsating Stars
vysmaw: Fast visibility stream muncher

ASCL poster at ADASS XXVII

ASCL poster at ADASS XXII in Santiago, Chile

The Astrophysics Source Code Library (ASCL), established in 1999, is a citable online registry of source codes used in research that are available for download; the ASCL’s main purpose is to improve the transparency, reproducibility, and falsifiability of research. This presentation discusses the 2017 improvements to the resource, including real-time data backup for submissions and newly-published entries, improved cross-matching of research papers with software entries in ADS, and the expansion of preferred citation information for the software in the ASCL.

Alice Allen, Astrophysics Source Code Library/University of Maryland
Bruce Berriman, Caltech/IPAC-NExScI
Kimberly DuPrie, Space Telescope Science Institute/Astrophysics Source Code Library
Jessica Mink, Smithsonian Astrophysical Observatory
Robert Nemiroff, Michigan Technological University
P.W. Ryan, Astrophysics Source Code Library
Judy Schmidt, Astrophysics Source Code Library
Lior Shamir, Lawrence Technological University
Keith Shortridge, Knave and Varlet
Mark Taylor, University of Bristol
Peter Teuben, University of Maryland
John Wallin, Middle Tennessee State University
Rein H. Warmels, European Southern Observatory

Download poster

September additions to the ASCL

Ten codes were added to the ASCL in September 2017:

bmcmc: MCMC package for Bayesian data analysis
celerite: Scalable 1D Gaussian Processes in C++, Python, and Julia
DanIDL: IDL solutions for science and astronomy
DCMDN: Deep Convolutional Mixture Density Network
DOOp: DAOSPEC Output Optimizer pipeline

MagIC: Fluid dynamics in a spherical shell simulator
MeshLab: 3D triangular meshes processing and editing
MSSC: Multi-Source Self-Calibration
PHANTOM: Smoothed particle hydrodynamics and magnetohydrodynamics code
SPHYNX: SPH hydrocode for subsonic hydrodynamical instabilities and strong shocks

July and August additions to the ASCL

Seven codes were added to the ASCL in July 2017:

CCFpams: Atmospheric stellar parameters from cross-correlation functions
Gala: Galactic astronomy and gravitational dynamics
HRM: HII Region Models
pyaneti: Multi-planet radial velocity and transit fitting
PyMOC: Multi-Order Coverage map module for Python

SASRST: Semi-Analytic Solutions for 1-D Radiative Shock Tubes
swot: Super W Of Theta

And thirty codes were added to the ASCL in August 2017:

4DAO: DAOSPEC interface
ALCHEMIC: Advanced time-dependent chemical kinetics
ANA: Astrophysical Neutrino Anisotropy
Astroquery: Access to online data resources
ATOOLS: A command line interface to the AST library

BAGEMASS: Bayesian age and mass estimates for transiting planet host stars
CINE: Comet INfrared Excitation
ComEst: Completeness Estimator
CRISPRED: CRISP imaging spectropolarimeter data reduction pipeline
CUTEX: CUrvature Thresholding Extractor

DISORT: DIScrete Ordinate Radiative Transfer
empiriciSN: Supernova parameter generator
ExoSOFT: Exoplanet Simple Orbit Fitting Toolbox
extinction-distances: Estimating distances to dark clouds
FIEStool: Automated data reduction for FIber-fed Echelle Spectrograph (FIES)

GAMBIT: Global And Modular BSM Inference Tool
GANDALF: Gas AND Absorption Line Fitting
GMM: Gaussian Mixture Modeling
iSEDfit: Bayesian spectral energy distribution modeling of galaxies
KERTAP: Strong lensing effects of Kerr black holes

LCC: Light Curves Classifier
Naima: Derivation of non-thermal particle distributions through MCMC spectral fitting
PACSman: IDL Suite for Herschel/PACS spectrometer data
PBMC: Pre-conditioned Backward Monte Carlo code for radiative transport in planetary atmospheres
pyLCSIM: X-ray lightcurves simulator

RM-CLEAN: RM spectra cleaner
SINFONI Pipeline: Data reduction pipeline for the Very Large Telescope SINFONI spectrograph
STools: IDL Tools for Spectroscopic Analysis
TWO-POP-PY: Two-population dust evolution model
XDGMM: eXtreme Deconvolution Gaussian Mixture Modeling

In conclusion 2 …

As promised in a previous post, here are a few slides from the second block of EWASS 2017 software presentations.


Reproducibility in Era of Data-Driven Science, Kai Polsterer (slides: PDF)

Conclusion: publications should be open access. Data should include all raw, test, training, and reference data in addition to detailed results. Software should be put into repositories and registries, and parameters, configuration, and environment needed to run the software should be saved as much as possible.


 

Should short codes used for astronomy research be made public?, Robert Nemiroff (slides: PDF)

Summary and key points. Short codes can be vitally important, yet we never see them, making science less falsifiable. Let's reverse this. Submit your important short codes with your papers, like Figures, OR to the ASCL (at ascl.net). Science, on the whole, will be stronger.


 

Giving credit where credit is due: the role of ADS in discovering and citing software in scholarly publications, Sergi Blanco-Cuaresma (slides: PDF)

SAO/NASA ADS. Identification: What software version? Preservation: Is that version still available? Attribution: Is the right set of authors receiving the credit?


 

Fifteen years of WISE technology software development and operations, Gijs Verdoes Kleijn (slides: PDF)

The future: (Big) Data Science and Education. University of Groningen astronomy student admissions tripled since 2010. Strategy: grow a new generation of data scientists


 

CDS reference services supporting astronomy research, Mark Allen (slides: PDF)

Challenges and Opportunities. Multi-wavelength, multi-messenger and time-domain astrophysics. Changing modes of publication -- data associated with publications. Responding to the change in scale - Big Data. New technologies - not too soon, not too late. Bringing the code to the data. Continued adaptation to meet community needs.


In conclusion 1…

Here are a few slides from presentations mentioned in a previous blog post; slides from more of the talks at EWASS will be covered in another post.


Software development best practices from Astropy, Thomas Robitaille (slides: PDF)

All contributions are made in GitHub repositor(ies). All contributions are reviewed via pull requests. Test suite run using pytest. Docs written in Sphinx, hosted on ReadTheDocs. Continuous integration on Travis AppVeyor, Circle CI.


A Computer Science Perspective on the Astronomy Research Software Process by John Wenskovitch (slides: PDF)

Summary: 1. Acknowledgement of strengths. 2. Version control. a. Use it. b. Commit often. 3. Frequent communication. 4. Manage feature requests. 5. Collaborate with an expert.


TARDIS: A radiative transfer code, an open source community, and an interdisciplinary collaboration by Wolfgang Kerzendorf (slides: PDF)

Developing simulation codes. Science discovery needs to be the key driver (everything else is secondary). Only write code that doesn't exist anywhere else. Many of the software engineering techniques are geared towards team development -- not always applicable.


Research software best practices: Transparency, credit, and citation by yours truly (slides: PDF, PPTX)

You can change the world! Or at least a little piece of it. Release your code. Specify how you want your code to be cited. License your code. Register your code. Archive your code.

Dagstuhl Manifesto on Citation: I will make explicit how to cite my software. I will cite the software I used to produce my research results. When reviewing, I will encourage others to cite the software they have used.

ASCL projects at the EWASS Hack Together Day

The European Astronomical Society (EAS) European Week of Astronomy and Space Science (EWASS) meeting, held June 26-30 in Prague, had its first Hack Together Day, coordinated by Abigail Stevens (U Amsterdam), Amruta Jaodand (ASTRON), and Matteo Bachetti (INAF-Osservatorio Astronomico di Cagliari).

The projects were varied and some participants worked on more than one. I proposed two ASCL-related projects for this, both of which had willing participants. Daniel Evans (Keele U) worked on creating a dataset of keywords for ASCL entries based on their associated papers, and Jessica Kirkby-Kent (Keele U), Eleonora Alei (INAF – Astronomical Observatory of Padua) and I worked on finding preferred citation information for codes that didn’t have it. Since we were working from an open Google spreadsheet, the link to the spreadsheet was tweeted out several times during the Hack Together Day and later, allowing others not at EWASS to participate in this Hack Together Day project that day and in subsequent days, to good effect.

Kirkby-Kent, Alei, and I looked for preferred citation info for at least 184 codes and found this information for 45 codes, so we have a yield of 24.5% — we found citation information on 24.5% of the code sites we looked at. Another two codes had citation information added to them by unknown users during the Hack event, and later, citation information was added for several more codes. I spent last weekend with the data Kirkby-Kent, Alei, mostly anonymous others, and I gathered and adding the collected preferred citations to ASCL entries, editing a total of 52 entries to add this important information. I still have a bit of information to go through and get clarification on, and will soon add that, too, and then will go back through the Google spreadsheet again, as I see someone — I suspect Kirkby-Kent! — has been methodically adding more information. (Thank you!!)

Evans continued to build the dataset after EWASS and found a few bibcode anomalies along the way, which I’ll share with ADS at a later time. He has sent me email to let me know his searching is complete and he is getting the results into reasonable shape so this information can be added to the ASCL, too. Having this information will be very useful to anyone who uses the ASCL to find software. (Thank you!!)

I am so glad I participated in the Hack Together Day, and am grateful to Evans, Kirkby-Kent,  Alei, and all others who gathered information for the ASCL, and to Jaodand, Stevens, and Bachetti for planning it. Thank you!

Developments and Practices in Astronomy Research Software at EWASS 2017

The annual meeting of the European Astronomical Society (EAS), the European Week of Astronomy and Space Science (EWASS), was held June 26-30 in beautiful Prague. As mentioned in a previous blog post, Abigail Stevens (U Amsterdam), Amruta Jaodand (ASTRON), Matteo Bachetti (INAF-Osservatorio Astronomico di Cagliari), Rein Warmels (ESO), and I organized a Special Session titled Developments and Practices in Astronomy Research Software. Special Sessions at EWASS can be from one to three 90-minute blocks; we organized three blocks, each with its own focus and all scheduled on Wednesday, June 28, which were:

Best practices for code development and management
Perspectives in research software
Astronomy software packages review

The first two sessions opened with review talks, then had a series of slightly shorter presentations, each with a particular focus. Each of these sessions concluded with a 30-minute period in which the floor was open to all to ask questions of the speakers and discuss the issues and information that had been shared during the 90 minutes. The third session offered talks on specific popular software packages and concluded with lightning talks on the software posters submitted to this Special Session. In addition to this series of talks, a Hack Together Day was organized collaboratively that offered more information on and assistance with installing and/or using many of the software packages presented.

Session titles and presenters for the software sessions that Abigail Stevens (U Amsterdam), Amruta Jaodand (ASTRON), Matteo Bachietti (INAF-Osservatorio Astronomico di Cagliari), Rein Warmels (ESO), and I organize are listed below, and if you want to read through the Storify of session tweets, compiled by Stevens as a Hack Together Day project, that’s here: https://storify.com/abigailstev/developments-and-practices-in-astronomy-research-s


Best practices for code development and management
Moderator: Rein Warmels, ESO, Germany

This session opened with a talk by Simon Portegies Zwart (Leiden University, NL), author of AMUSE and other astro codes, on Reproducible science in scientific computing. He laid the groundwork for this block of talks by presenting the difficulties of reproducibility in simulation software, the best practices his group uses, and the philosophy behind AMUSE, which includes standardizing interfaces and automating as much as possible. His talk included simulations that made for an extremely large presentation file, so a partial set of his slides is provided.
(slides: PDF)

Simon Portegies Zwart presenting at EWASS

Simon Portegies Zwart

In the interest of time, I will not summarize the other talks in this block, but will say you should have been there! These were excellent presentations with many great practices and ideas shared. In the discussion, moderated by Warmels, someone asked about “short codes,” and as luck would have it, the next block had a talk on just that topic. There was disagreement on some voiced opinions, and many ideas shared that warrant greater discussion.

The other talks in this block were:

Software development best practices from Astropy
Thomas Robitaille, Freelance, UK (slides: PDF)

A Computer Science Perspective on the Astronomy Research Software Process
John Wenskovitch, Virginia Tech & Allegheny College, US (slides: PDF)

TARDIS: A radiative transfer code, an open source community, and an interdisciplinary collaboration
Wolfgang Kerzendorf, ESO, DE (slides: PDF)

Research software best practices: Transparency, credit, and citation
Alice Allen, ASCL, US (slides: PDF, PPTX)


Perspectives in research software
Moderator: Alice Allen, ASCL, USA
/
Kai Polsterer (Heidelberg Institute for Theoretical Studies, DE) set the stage for the second block in the Special Session with his presentation Reproducibility in Era of Data-Driven Science. He also highlighted the difficulties of reproducibility, among them that different computing environments can produce different results from the same code, and though he acknowledged the difficulties in doing so, advocates that publications, datasets (including raw and training data), codes, component and software configuration, and computing environments need to be shared for full reproducibility. Or as John Wenskovitch summarized in a tweet during this presentation, “Publish everything. EVERYTHING. Architecture, model, code, data, parameters, …” We are not there yet, but must share what we can when we can to increase reproducibility.
(slides: PDF)

Kai Polsterer, image by @K_Bonson

The other talks in this second of three blocks were:

Should short codes used for astronomy research be made public?
Robert Nemiroff, Michigan Technological University, US (slides: PDF, PPTX)

Giving credit where credit is due: the role of ADS in discovering and citing software in scholarly publications
Sergi Blanco-Cuaresma, Harvard-Smithsonian Center for Astrophysics, US (slides: PDF)

Fifteen years of WISE technology software development and operations
Gijs Verdoes Kleijn, University of Groningen, NL (slides: PDF)

CDS reference services supporting astronomy research
Mark Allen, CDS, Observatoire Astronomique De Strasbourg, FR (slides: PDF)


Astronomy software packages review
Moderator: Amruta Jaodand, ASTRON, NL

The third block of talks in this Special Session presented software packages useful for software research, from the well-established AstroPy to, in the short poster presentations, newly-developed software such as SPARTAN. The talks in this 90-minute block were:

The Astropy Project
Thomas Robitaille, Freelance, UK (slides: PDF)

Stingray and Dave: Spectral timing for all
Matteo Bachetti, INAF-Osservatorio Astronomico di Cagliari, IT (slides: PDF)

Living on the fringe: Making CASA ready for VLBI
Ilse van Bemmel, JIVE, NL

Interactive widgets for the Jupyter notebook
Maarten Breddels, Kapteyn Astronomical Institute, NL (Jupyter notebook, ipywidgets demo (PDF), poster)

Lightning poster talks


Again, you should have been there! One blog post cannot possibly convey everything shared in this Special Session, but the slides the presenters have shared captures some of the great goodness in these talks. My thanks to all the presenters, to my co-organizers, and to the attendees who made this session so interesting and excellent, to EWASS for accepting our proposals, and to HITS for providing the ASCL with funding that allowed us to participate.

ASCL at the 2017 European Week of Astronomy and Space Science (EWASS) meeting

The European Week of Astronomy and Space Science (EWASS) was held June 26-30 in Prague and attended by over 1,100 people, and the ASCL was there! This post is an overview of the ASCL’s participation in the event; a subsequent post (or two) will provide more detailed information and links to slide decks for sessions the ASCL was involved in organizing.

Program page for software talks

Program page for software talks
Image by Amruta Jaodand

This was my first time attending EWASS, which was initially brought to my attention by Keith Smith (Science). It was also my first time in Prague. My activities since the meeting have included submitting proposals (with others) for EWASS 2018, which will be in Liverpool, and pricing short-term apartment rentals in Prague; clearly, I liked both the meeting and the city very much! My thanks to Keith for cluing me in to this fine meeting.

ASCL Advisory Committee member Rein Warmels (ESO) and I partnered with Abigail Stevens (U Amsterdam), Amruta Jaodand (ASTRON), and Matteo Bachetti (INAF-Osservatorio Astronomico di Cagliari) on software-related sessions for EWASS 2017; our collaboration resulted in a day of talks on Wednesday called Developments and Practices in Astronomy Research Software and a Hack Together Day on Thursday, this latter coordinated by Stevens, Jaodand, and Bachetti.

The ASCL was well represented, with ASCL co-founder Robert Nemiroff (MTU) giving a talk on short codes and Warmels and I each moderating 90-minute sessions on software, both with a discussion period; I also gave a presentation on the ASCL and participated in the Hack Together Day.

The Hack Together Day had numerous exciting projects; the ASCL’s projects were less glamorous than most others but yielded really useful information, some of which has already been added to ASCL entries.

Our collective efforts went very well, despite a few worrisome moments along the way. The room our Special Session presentations were in had 98 seats; perhaps 90% were filled for these sessions, and there were people also standing in the room. The presenters/presentations were great and the discussions were lively, and more information about these sessions will be posted soon.

There was of course much much more to EWASS than our efforts; notable for those software-inclined were the astrometry, big data, and astroinformatics sessions and associated posters for all of these sessions. In all, an excellent conference!