Summary list of Survey Executive Summaries:
This pages give a summary of the conclusions of the global CCP survey (copied from the Main Page) plus summaries of the findings of the two smaller surveys of the CCPi and CFD communities. We also make recommendations for the future support of visualisation services and suggest how these surveys might be repeated in the future to monitor progress.
For the Global CCP survey:
- Three packages are the most-used packages by 26% of respondents. Conversely, another 31 packages are used by one or two users and account for a further 26% of respondents.
- Producing publication quality plots is the most-used technique.
- However, the features making these packages the favourites are:
- Software that is written specifically for their domain of interest.
- Large datasets are handled efficiently.
- Scripting or other ability to extend the tool is required.
- Users second most favoured packages are general purpose visualisation tools.
- Users were given five options for selecting their most required development. None emerged as being more needed than the others.
- Conversely, large amounts of memory was clearly the most important requirement for high performance visualisation.
- The main future challenges are suggested to be
- The ability to handle large amounts of data
- The ability to operate in a distributed environment.
For the CCPi survey:
The following conclusions were drawn:
- The survey was focused on what changes should be made to the set of supported tools? ImageJ, Avizo and ParaView products were favoured. A previous popular tool for development, VolView, proved to be unpopular with users and therefore was dropped.
- The type of software development supported should focus primarily on the areas where the network already has skills that can be leveraged (e.g. reconstruction) with new partners being sought to fill gaps (e.g. quantification and segmentation) for the future. Training was shown to be a requirement at different levels with outreach and metadata to be a lower priority.
- Over the following six months changes have happened that have resulted in the following actions:
- Quantification visualisation tools are now being developed with API links for ImageJ, Avizo and ParaView; the most popular specific tools.
- Outreach events are continuing but at a lower effort level.
- Software show-and-tell events along with related seminars now aim to focus on guidance and use of the products as well as the research solution that is being solved. These are now becoming monthly events and also aim to keep a user and developer community connected.
- Increase in cross training sessions: there is a collaboration now across Diamond Light Source / RCaH / University of Manchester and SCD/STFC labs with links to the Harwell Imaging Partnership and ISIS (Neutron Spallation Source). Four annual training events are being held at DLS/RCaH and a further four annual training events at UoM with specialist events being held at SCD/STFC in RAL - all of these allow for cross-attendance throughout the CCPi network.
- The survey allowed for representation at celebration events; including the Queen's Anniversary Prize at Manchester and the ToScA exhibition space where we sponsor poster prizes.
- Quarterly Developers' Workshop days are now held in CCP remote institutions and focus on areas that the survey stated there were needs.
For the CFD survey:
The survey of tools and techniques used within project gave the following main conclusions:
- Visualisation is most important in analysis; but also useful in problem definition, and mesh generation.
- ParaView is high on the list of preferred visualisation tools. But gnuplot, Matlab, xmgrace, and Pgplot are also required.
There are strong preferences to version number as features change. This may unify in the future.
Recommendations for a Future Vis Service
A future UK Vis-Service is worth exploring and a very worthy venture, but an obvious issue is the wide range and choice available of tools that any service would have to confront and support. Once all analysis is complete a list of discussion points that can be taken away will be placed here.
We were asked to do four workpackages that are being developed and presented throughout this site.
- WP1 We carried out an audit of the tools used and in a committee created a list of the common 34 packages for the range of CCPs. A further 30+ packages were mentioned in comments within the survey results. This in further work has been expanded to emphasise the long tail of tools available.
- WP2 User groups are very important as researchers and developers do not always associate CCP as their main motivation. The groups from the national facilities connected to STFC are included; DLS, ISIS and CLF. Other groups including the TSB (UK Innovate) Space Applications Catapult, RAL Space due to changing structure have been postponed for a future study. We also included CCPForge users directly: but only through news letters and a future study should directly address these users.
- WP3 The currently unfunded CCPs were invited to attend and augmented these values, as well as supported alternative bids.
- WP4 A final part in progress are certain software audits of other related organisations; including the German build IBM SuperMUC, two universities in Australia; visualisation suites at Curtin University and Australian National University and the Space applications Catapult.
There have been some requests for further work and also some groups delayed implementation. Currently there are four actions:
1. Two sub-surveys requested: We surveyed both the old non-funded CCPs which included
- CCP1 The electronic structure of molecules (defunct link)
- CCP3 Computational studies of surfaces (defunct link)
- CCP6 Molecular quantum dynamics
- CCP13 Software for fibre and polymer diffraction
- CCP14 Powder diffraction
and surveyed the national facilities lists:
- STFC: Diamond Light Source
- STFC: ISIS - Neutron Spallation Source
- STFC: CLF - Central Lasers Facility
These links gathered 37 extra responses that were merged together with the total (6 from non-funded CCPs and 31 from the user communities). We have been asked to look specifically at the CLF and the ISIS user communities separately in a short extra report. From informal comments we believe users from non-funded CCPs have transferred to a funded CCP, a facilities user list, or moved on.
2. Rerunning the global survey: A further survey is being planned for Summer 2015, which will then track temporal changes between the CCPs and also indicate the changing nature from the new CCPs just recently funded.
3. Space Applications Catapult Audit: One part of the Optional Appendices was a page on the TSB Space Application Catapult Centre - just recently rebranded to becoming a UK Innovation site. They have recently built two new visualisation nodes and installed different and distinct software links to be reevaluated. This has come about due to change of use from a specific type of data show-and-tell space, to a command-and-control center with different visualisation needs. An associate is assisting in this move and the transition and thus as there is a new set of different users an audit is proposed in Spring 2015. We have requested this list to then compare against the Global CCP survey.
4. Global Comparison: We are in email contact with similar structures and have evaluated through the CCPi in particular specific tools from the Australian National University and Curtin University. Comparative study with audits are underway with these and at the German build IBM SuperMUC.
We have started to look at a post-six month review to see where changes may have occurred; the first has complete with the CCPi initial survey and further work will be undertaken. We have been also asked to look at future user communities:
- CCP5 and CCP_EM as they embark on tomographic reconstruction and visualisation of 3D volumes in the next phase of CCP funding.
- CCP-NC involvement in remote visualisation and web based visualisation with Jmol for example. http://www.ccpnc.ac.uk/magresview/magresview/magres_view.html?JS
- CCP_PET/MR, a new recently funded CCP, that has specific 4D visualisation needs including the addition of uncertainty visualisation to human based 3D scans.
We are always open to taking on further studies and sub-studies, for other groups related to the CCP program.
Martin Turner email
Ronald Fowler email
Tim Morris email
We welcome feedback and also thank all those that gave indirect and direct contributions.