This website does readability filtering of other pages. All styles, scripts, forms and ads are stripped. If you want your website excluded or have other feedback, use this form.

ADS Help

What’s New

This page is updated monthly with a list of new ([new]) and improved ([improved]) features and bug fixes ([fixed]) to our website, API, data pipelines, and data holdings. We also list operations issues and improvements of note ([ops]).

To receive this listing via monthly email newsletter, along with announcements and new blog posts, sign up here.

May 2020

  • Website and API
    • [new] Add myADS dashboard
    • [new] Blog post on updates to the UI
    • [improvement] Customize Settings is now called Settings
    • [Fixed] Fix to bug in delete button for Custom Format (in Settings)
  • Data holdings and pipelines
    • 145,262 more bibcodes, 624,039 more citations
Development details

April 2020

  • Website and API
    • [improved] Add help menu showing hotkeys
    • [improved] Add new journal format preference
    • [fixed] Libraries now return library owner correctly
  • Data holdings and pipelines
    • 70,057 more bibcodes, 2,846,429 more citations
Development details

March 2020

  • Website and API
    • [improved] Libraries: improved readability of emails notifying users of updated permissions
    • [ops] Released myADS backend for beta testing
    • [ops] Made author_count a stored field to support optimized UI requests
  • Data holdings and pipelines
    • 76,515 more bibcodes, 1,399,160 more citations
    • [ops] New GCN Circulars are now being added on a weekly basis, and missing abstracts and metadata for older abstracts are slowly being filled in
Development details

February 2020

  • Website and API
    • [new] Can now add library collaborators with varying permission levels, under Manage Collaborators on the library’s page
    • [new] Can now exclude selected records from a results list
    • [new] Simple hotkeys are now available for the search results page, such as using the left and right arrows to page through results (full documentation forthcoming)
    • [improved] Website improvements: improved linking to help pages and accessibility documents, added simple search on libraries page, improved styling for printing the results page, no longer wrapping the current query with extraneous parentheses when running a second-order query from the Explore menu
    • [improved] Export improvements: added doctype of editorial, which maps to @article in BibTeX; now support BibTeX export without AASTeX macros; improved tech report output; added enumeration to BibTeX cite keys if duplicates exist in the export
    • [improved] Search: improved query parsing
    • [fixed] Fix issues on abstract page related to showing the abstract and expanding author lists
    • [fixed] Export fixes: removed quotes around month and year in BibTeX exports, no longer encoding linefeeds for html encoding, now exporting DOI if no volume and page exist for a record
    • [fixed] Search: implemented a fix for long phrase searches that timeout or return no results
    • [fixed] Fix for entry dates in myADS email query links
    • [ops] Website: improved Google Analytics implementation by removing duplicate calls
    • [ops] Search: implemented better handling and protections for long-running searches
  • Data holdings and pipelines
    • 54,037 more bibcodes and 697,752 more citations
Development details

January 2020

  • Website and API
    • [new] Search: Added affil as virtual field for affiliations, including aff, aff_id, inst fields
    • [new] New blog post on searching by author affiliations
    • [new] The ADS Users Group final report for the November 2019 meeting is now available on the ADSUG page
    • [new] Added Accessibility page to the help pages
    • [improved] Users will be emailed when their library permissions are changed
    • [improved] Website improvements: updated fields listing in “All Search Terms” dropdown menu and autocomplete, including changing “database” to “collection” in autocomplete to better match facets; added Clear buttons to Paper Form
    • [improved] Export: for BibTeX book exports, use pub instead of pub_raw and aff instead of aff_raw
    • [improved] Help pages: added search syntax for author_count field, removed outdated Classic references, renamed “Tutorials” section to “Troubleshooting” and cleaned up contents, added link to YouTube channel in “Videos” section
    • [fixed] Fixed bug for too-long library descriptions
    • [fixed] Export: fixed AASTeX format with comma in citation before ampersand (&)
  • Data holdings and pipelines
    • 27,235 more bibcodes, 363,886 more citations
    • [fixed] Bug fixes to resolve a number of errors in the fulltext extraction pipeline, including removing non-standard parsing, ignoring poorly formatted facilities information, expanding the encoding and decoding used by the XML parser to use in the HTML parser, and improving CDATA removal to handle invalid XML content
Development details

December 2019

  • Website and API
    • [improved] Website improvements: accessibility updates to bring site to WCAG 2.0 AA & AAA baselines; if query entered in all caps returns no results, suggest a lowercase version of the query
    • [improved] Added API support for export of individual citation/usage histograms (equivalent to the Classic nph-ref_history?refs=CITATIONSi|AR)
    • [improved] Updated search syntax: collection: can now be searched as for database:, as in collection:astronomy
    • [fixed] Website fixes: fixed potential security issue; increased number of papers that can be processed at once in metrics
    • [fixed] Fixed bug in author wildcard search
    • [fixed] Bugfix for generating transliterations
    • [fixed] Classic query translator: fixed issue with db_key2 translation in myADS queries; bugfixes for arXiv queries in myADS; fix to verify that dates are valid numbers; bugfix if a start param is provided but an ending param is not
    • [ops] In the citation helper, use the token of the user instead of the service-level token
  • Data holdings and pipelines
    • 85,622 more records, 974,312 more citations
    • 162 notebooks from the PHaEDRA project were added (representing 34,797 scans)
    • [new] The fulltext pipeline is now extracting facilities information where available
    • [ops] A Unicode bug was fixed in the fulltext pipeline, reducing overall extraction error rate by a factor of 20
    • [ops] A test version of the new myADS pipeline was deployed for debugging and testing for future release
Development details

November 2019

  • Website and API
    • [improved] Updates to the Paper Form: added ApJL to Publication field autocomplete; added a link to a full list of available bibstems
    • [improved] Improved access for reference managers
    • [improved] Added unicode support for author affiliation report
    • [improved] Added several new data link types
    • [fixed] Fixes to the Paper Form: removed the requirement to provide a Publication in the Journal Search, updated styling
    • [fixed] Fixes to the author affiliation report, including selecting the first non-(None) entries in author affiliations
    • [fixed] Fixes in the export service, including adding an attribute to the Dublin Core XML (DC-XML)
    • [fixed] Fixes and improvements to myADS query translations
    • [ops] Improved internal logging
  • Data holdings and pipelines
    • 45,328 more records, 506,719 more citations
    • [ops] A Solr schema change required reprocessing all bibliographic data
    • [ops] The affiliations database was updated with new affiliations strings
    • [ops] Over the past week, 99.8% of queries returned successfully
    • [ops] The fulltext pipeline now has error reporting
Development details

October 2019

  • Website and API
    • [new] Basic, HTML version of ADS now available; links are shown in the splash screen and footer
    • [new]A Final Farewell to ADS Classic,” a blog post with more information about the retirement of Classic
    • [new] Added information on data curation and availability, formerly available in ADS Classic, to a new Legacy menu in the help pages
    • [new] Added handling for myADS queries linked in Classic-generated myADS emails
    • [improved] Updates to the Paper Form, including addition of the reference resolver and styling updates
    • [improved] Updates to the Classic Form, including addition of a sort selection and a General collection checkbox; collection checkboxes now respect user settings selections, have updated wording
    • [improved] Library updates: deleting an item from a library no longer takes you back to the first page of the library
    • [improved] Added authorcutoff option for BibTeX export, to specify the max number of authors to show
    • [improved] Added search syntax for searching for affiliations to help pages
    • [improved] Added Github data source
    • [improved] For redirected links from Classic, all warnings about using AND vs OR have been removed; ORs are no longer converted to ANDs
    • [fixed] Fixes to Classic Form keyword parsing
    • [fixed] Fixed normalized citation count on results page
    • [fixed] Fixed bug that caused some Library Link URLs to not work properly
    • [fixed] Export service: fixed ADS fielded format to return ISSN instead of ISBN
    • [ops] Update website to use jQuery to v2.2.4, added Reactify plugin
    • [ops] Converted bigquery to use docs
    • [ops] Internal improvements to the resolver gateway and resolver microservice
  • Data holdings and pipelines
    • 37,583 more records, 605,305 more citations
    • [ops] Our VMWare-based pipeline servers had to be restarted.
    • [ops] Over the last week, 99.93% of queries returned successfully.
Development details

September 2019

  • Website and API
    • [new] Added option to transfer ownership of a library, accessible from the Manage Access tab in the library
    • [new] In Application Settings, added the ability to set a default search form (Modern, Classic, Paper)
    • [new] Added infrastructure endpoint to eventually support myADS settings imports
    • [improved] If sidebars are hidden, requests to populate them are now blocked to improve load speed
    • [improved] Library exports are now using the docs() syntax, to improve speed
    • [improved] Added more flexibility for specifying BibTeX key format and max author settings for BibTeX and BibTeX ABS formats
    • [improved] Improved scoring algorithm deployed; sort by score to use
    • [fixed] Bug fixes to web interface: Classic search form now respects collections preferences set in Application Settings, fixed bug that caused the number of results to occasionally disappear on the results page, fixed bug for displaying special characters in the publication field on the abstract page
    • [fixed] Fixed which field is being exported as the publisher field
    • [ops] Add more info to logging requests
    • [ops] Streamlined and added to Google Analytics timing logging
    • [ops] Internal updates to builds and dependencies
  • Data holdings and pipelines
    • 53,878 more records, 613,711 more citations
    • [fixed] Fixed citation_count field, some records had no value instead of a 0
    • [fixed] Reviewed and fixed metadata parse issues for all bibcodes
    • [fixed] Fixed publication data on PNAS records
    • [fixed] Fixed 2019GeoJI records.
    • [ops] Updated affiliation field for all bibcodes
    • [ops] Over the last week, 99.99% of queries returned successfully.
    • [ops] Fulltext pipeline XML extraction updated to BeautifulSoup4
Development details

August 2019

  • Website and API
    • [new] Activated symbolic date math logic. Searches like entdate:[“NOW-1MONTH” TO NOW] will now work
    • [new] Videos section added to help pages, including recordings of Office Hours talks
    • [improved] Several improvements to Solr search engine scoring: improved the algorithm for choosing amongst synonyms, updated handling of multi-phrase synonyms, improved relevancy scoring, allow for multi-multi-valued affiliations (e.g. authors with multiple affiliations), improved handling of author accents with transliterations
    • [improved] Added clarification to Help pages’ FAQ section about replacements for Classic’s “Get citation lists” and “Get reference lists” functions
    • [fixed] Bug fixes to export service: better detection of math mode, limit the number of authors in MNRAS-style export
    • [fixed] Fixed bug when there is a caret in the query string in object searches
    • [fixed] Fixes to Solr search engine scoring: fixed NGC object search handling/tokenization, fixed year:xxxx-yyyy searches, fixed issue with constant scoring for position searches, fixed bugs affecting authors with multiple initials, scoring fix for first-author search using the caret (^) operator
    • [ops] More info included with feedback form emails
    • [ops] Better internal logging, including logging user ID with requests
    • [ops] Better error handling for failed cone object searches
    • [ops] Improved Solr warm-up, for performance
  • Data holdings and pipelines
    • 47,005 more records, 835,256 more citations
    • [fixed] Fixed bug in search code that affected 0.5% of facet searches. Now, 99.97% of queries return now successfully.
    • [fixed] The fulltext pipeline had inconsistent encoding issues that were fixed by detecting the encoding of a file and decoding it before parsing.
    • [ops] Daily updates failed on two occasions, one due to central server room network issues and one from an abnormally large log file filling a disk.
    • [ops] Updated 24469 ICRC records, 4309 arXiv records, 1114 Zenodo records, and 25 Minor Planet Bulletin records.
    • [ops] Improved handling and internal reporting of fulltext pipeline errors.
Development details

July 2019

  • Website and API
    • [new] Citation key in BibTeX exports is now configurable
    • [new] Maximum number of authors to display in a BibTeX export is now configurable
    • [new] Documentation: object search syntax added to search syntax help pages, new tutorial available for generating files for UI troubleshooting
    • [new] New blog post on user-developed tools
    • [improved] Updates to feedback form, including added links to correction forms
    • [improved] Application settings page now auto-saves
    • [improved] Documentation: overhaul of custom export format documentation
    • [fixed] Fixed issue for Internet Explorer 11 users
    • [fixed] Updated BibTeX export files to use .bib instead of .bbl extension
    • [fixed] Fixed export menu ordering
    • [fixed] Fixed table of contents bugs
    • [fixed] Fixed library sorting bug
    • [fixed] Fixed property logic in Classic form
    • [fixed] Fixed issue with handling long author list in exports
    • [fixed] Fixed bug for records with a certain EID format that occurred with some export formats
    • [fixed] Updates to date/pubdate and bibstem fields in exports
    • [fixed] Fixed AASTeX export format issue
    • [fixed] Fixed indentation on custom export formats
    • [fixed] No longer doing TeX manipulation of strings in math mode during export
    • [fixed] Fixed several logging error messages
    • [fixed] Fixed cone search functionality in object searches
    • [ops] Now using https instead of http for calls to NED and SIMBAD
    • [ops] Updated rate limiting for searches
  • Data holdings and pipelines
    • 45,499 more records, 582,817 more citations
    • [ops] References were missing for at least 75 bibcodes. This was corrected by resending all reference data.
    • [ops] Detected at least two bibcodes are missing the arxiv_class field. Correction to metadata has been requested.
    • [ops] Updated our affiliation database with hundreds of new definitions and reprocessed all affiliation strings.
Development details

June 2019

  • Website and API
    • [new] Select desired articles and limit search results to the selected set using the new “limit to” button (visible after selecting one or more articles)
    • [new] Search examples on Modern form are now clickable links
    • [improved] Improved wording and functionality when using second-order operators from the Explore menu for a selected group of articles
    • [improved] About menu includes link to What’s New page
    • [fixed] Better error handling and improved performance issues
    • [fixed] Improved client-side caching
    • [fixed] Fixed sorting by normalized citations
    • [fixed] Fixed sorting during export
    • [fixed] Fixed issue to now allow results to open in new tab
    • [ops] Improved session handling
    • [ops] Increased rate limits for legitimate traffic
  • Data holdings and pipelines
    • 54,835 more records, 767,576 more citations
    • [improved] Improved reliability of data ingest pipeline
    • [improved] Updated solr records to use improved bibstem and institution fields
    • [fixed] Changed default value for normalized citation count field to fix sorting issue
    • [ops] Fixed publisher bibcode for a set of conference papers
    • [ops] Deployed support for author/reviewer attributes
    • [ops] Recovered from server room cooling failure
    • [ops] Fixed links data for workshop
Development details

May 2019

  • Website and API
    • [new] Second order operators now available for a manually selected group of articles via the Explore menu
    • [improved] Library set operations - improved: user experience, error handling, default library descriptions, tool tips
    • [improved] Improved usage of reCAPTCHA
    • [improved] Removed day from pubdate quick-field format
    • [improved] Added IRSA data provider
    • [improved] Updated classic form to allow hyphenated search terms
    • [improved] Detect ctrl+click on links to help with Windows users
    • [improved] Added warning messages in the Classic Search Translator for title and abstract search errors
    • [fixed] Fixed routing issue that caused 404 pages to trap users
    • [fixed] Fixed issue causing stuttered scrolling on iOS devices
    • [fixed] Fixed associated papers widget to show properly
    • [fixed] Quote author names by default in classic form
    • [fixed] Fixed export output to remove extraneous characters
    • [fixed] Fixed public library routing Issue, and update other links with same issue
    • [fixed] Fixed library export control to respect selected sort
    • [fixed] Fixed issue causing abstract citation list to have wrong title
    • [fixed] Removed synonym replacement for object searches
    • [ops] Added content-type for bigquery requests from several internal services
  • Data holdings and pipelines
    • 61,016 more bibcodes, 719,093 more citations
    • [improved] Overnight arXiv records are now available sooner, due to code improvements
    • [improved] Improved error handling for OCR errors in papers
    • [improved] Improved generation of bibcodes when the page number overflows its field
    • [improved] Improved quality of metrics data
    • [new] In development: code to generate pages for web crawlers
Development details

April 2019

  • Website and API
    • [new] Implemented lazy loading of widgets to improve site performance
    • [new] New feature: library set operations, available under Action button within library module
    • [new] New search field: “inst” (institution) field is now available for users to search the set of curated affiliations, currently available from the left-side filters; this complements the existing “aff” (affiliation) field, which allows users to search the uncurated text of this field
    • [improved] Additional export formats added to be more compatible with Classic-style export
    • [improved] arXiv ID is now pushed with ORCID claims to improve record matching on the ORCID site
    • [improved] Improvements to showing/hiding the sidebars
    • [improved] Improved UX on fast connections
    • [improved] arXiv ID added to abstract screens
    • [fixed] Fix for default naming in library set operations
    • [fixed] Fixed several bugs for exporting citations: fixed G author format, fixed journal name for macro matching, fixes to be more compatible with Classic-style export
    • [fixed] Fixed several bugs in Classic query translator: fixed bugs in parsing bibstems to include/exclude, fixed bug when querying for a single author, fixed bug to ensure database selection is passed, cleaned up error messages
    • [fixed] Fixed bug to speed site load
    • [fixed] Fixed several ORCID bugs related to the ORCID login, claiming records with no abstract, claiming/updating records using an alternate bibcode, updating records from the ORCID profile screen, requiring user to log into ORCID again if ORCID login has expired
    • [fixed] Fixes to the Classic and Paper forms
    • [fixed] Fixes to library interface including who could view public libraries, fix for viewing large libraries in search results screen, fix for adding record to a library from the abstract screen
    • [fixed] Numerous bug fixes in the user interface to improve user experience
    • [fixed] Fixes to link handling and routing
    • [fixed] Fixes to ensure compatibility with older browsers and for users who have Google blocked
    • [ops] Fix to internal user account cleanup script
    • [ops] Infrastructure to support forthcoming new feature: docs() operator, for performing operations on a selected group of articles or library
    • [ops] Initial deployment of service to load static pages for abstracts to improve site speed; service still in development
    • [ops] Internal build-related updates, updates to continuous integration, updates to unit testing infrastructure
    • [ops] Changes in how errors from the Classic query translator are handled
  • Data holdings and pipelines
    • 51,795 more bibcodes, 799,237 more citations
    • [improved] Complete records from arXiv papers are now searchable several hours earlier.
    • [ops] Performance of our search engines continues to be monitored and improved.
Development details

March 2019

  • Website and API
    • [fixed] Fixed error for users with no works on their ORCID profiles
    • [operations] Updated “CXO” to “Chandra” as a data source name
    • [operations] Updated expiration dates for access tokens
  • Data holdings and pipelines
    • 57,929 more bibcodes, 836,963 more citations
    • [new] The augment affiliation pipeline was productized and has reprocessed millions of affiliation records
    • [improved] The full text pipeline was improved to better handle text in appendices and text from specific publishers
    • [improved] Production search engine performance has been improved
    • [operations] We had some issues with a Solr search engine instance restarting; we are still investigating
Development details

February 2019

  • Website and API
    • [improved] Better handling of requests to API to improve speed
    • [improved] Major back-end ORCID update, including many speed improvements, particularly for users with large profiles
    • [improved] Added new CfA logo to footer, updated footer styling
    • [improved] “Export” renamed to “Export Citation” on abstract page
    • [improved] Added “entdate” field and “similar” operator to Quick Fields menu
    • [fixed] Fixed issue where default database/collection was not always applied, even if set in preferences
    • [fixed] Fixed handling if an ORCID login fails
    • [fixed] Operators that require sorting by score are now sorting properly
    • [fixed] Copying and pasting into the search box no longer triggers the autocomplete
    • [fixed] Fixed export of accented characters
    • [fixed] Fixed behavior of %U, which outputs the URL of the bibcode, in custom export
    • [fixed] Year and month in BibTeX export are now wrapped in double quotes, per the BibTeX standard
    • [fixed] Fixed line breaks in the author and editor fields in the BibTeX export to not wrap in the middle of a name
  • Data holdings and pipelines
    • 65,903 more bibcodes, 769,972 more citations
    • [improved] We deployed improvements to our orcid pipeline and our master pipeline.
    • [improved] We continued to productize the affiliation enhancement pipeline.
    • [operations] Zendo based software citations ran in production mode.
    • [operations] All pipelines ran without interruptions for the month.
Development details

January 2019

  • Website and API
    • [new] Set operations (union, intersection, difference, copy) available for libraries when using the API (not yet available in the browser).
    • [fixed] Fixed how the custom export handles user-supplied LaTeX commands.
    • [operations] Internal improvements to request handling.
  • Data holdings and pipelines
    • 32,886 more bibcodes, 527,614 more citations
    • [new] Results of our affiliation enhancement project are becoming visible to users. We deployed improved affiliation data and faceted search support for several million bibcodes.
    • [new] Our first software citations via Zenodo (bibstem:zndo) are available.
    • [operations] Ingest pipelines was down for a day due to server room issues.
Development details