CCPSurvey2014 - Revision history

Zzalsmt2 at 13:46, 30 January 2015

2015-01-30T13:46:16Z

Zzalsmt2: /* Survey Presentation */

2015-01-30T13:42:35Z

‎Survey Presentation

Zzalsmt2 at 13:41, 30 January 2015

2015-01-30T13:41:21Z

Zzalsmt2 at 13:40, 30 January 2015

2015-01-30T13:40:50Z

Zzalsmt2 at 23:04, 28 January 2015

2015-01-28T23:04:31Z

Zzalsmt2 at 23:03, 28 January 2015

2015-01-28T23:03:54Z

Zzalsmt2: /* Survey Presentation */

2015-01-28T16:07:59Z

‎Survey Presentation

Zzalsmt2 at 16:05, 28 January 2015

2015-01-28T16:05:55Z

Zzalsmt2: /* Survey Presentation */

2015-01-28T15:50:23Z

‎Survey Presentation

Zzalsmt2: Created page with "Over 2014 the visualisation group, part of the Technology Division within SCD, has reconsidered the real visualisation needs of the computational sciences community. A series..."

2015-01-28T15:16:35Z

Created page with "Over 2014 the visualisation group, part of the Technology Division within SCD, has reconsidered the real visualisation needs of the computational sciences community. A series..."

New page

Over 2014 the visualisation group, part of the Technology Division within SCD, has reconsidered the real visualisation needs of the computational sciences community. A series of informal and formal surveys are underway and the first ones have tackled the Tomographic Imaging and CFD (Computational Fluid Dynamics) communities. These wanted to find out which tools were actually being used and the best methods to support them.

== Executive Summary ==

Key was a difference between choice of primary and secondary package:

* Three packages are the most-used packages by 26% of respondents.
* Conversely, another 31 packages are used by one or two users and account for a further 26% of respondents.

Producing publication quality plots is the most-used technique. However, the features making these packages the favourites are:

# Software that is written specifically for their domain of interest.
# Large datasets are handled efficiently.
# Scripting or other ability to extend the tool is required.

Users second most favoured packages are general purpose visualisation tools.

Users were given five options for selecting their most required development. None emerged as being more needed than the others.

Conversely, large amounts of memory was clearly the most important requirement for high performance visualisation.

The main future challenges are suggested to be

# The ability to handle large amounts of data
# The ability to operate in a distributed environment.

== Survey Presentation ==

Surprisingly, open source was not always the most important issue but the easy creation of plug-ins, new readers and writers, as well as analysis tools have been requested. �
There was also indicated a strong growth in the use of the ParaView visualisation system (http://www.paraview.org/) that is an open source, multi-platform data analysis and visualisation application where users can build systems including adding qualitative and quantitative techniques.

Q1 Home institutions

[[CCPSlide31.JPG|500px]]

Q2 Which CCP(s) are you involved with?

Q3 What software do you use for visualisation of data?

Q4 What visualisation techniques are important to your work?

Q5 Comments on the respondents' most used visualisation tool.

Q6 Same as question 5, for any other tool used.

Q7 Visualisation requirements. How important do you see the provision of the following (ed. Services)?

Q8 Requirements for high performance/advanced visualisation facilities. Do you have any need for access to (ed Services)

Q9 What do you see as the main challenges for visualisation in your domain now and in the near future?

[[CCPSlide31.JPG|500px]]

Q10 Any other comments?

Raw Comments
# Would be nice if there was an obvious preferred open source tomographic reconstruction code that we (STFC/EPSRC) could recommend to users and modify ourselves for our own needs. If there are candidates here, maybe publicise the options more widely?
# Would be nice to have somebody looking into maintenance and support of useful tools and software.
# Visualisation and application of calibrations to data go hand-in-hand together, thus the greatest visualisation tool won't be used much if it isn't integrated into a data handling flow. A good example is XCrysDen, which makes all the difference between just number crunching with wien2k and actually seeing what you're doing.
# It would be great if the visulisation tool developers would start to collaborate to develop libraries, data formats etc that could be shared between them, to speed up the development of new tools and functionality, and allow users access to the full spectrum of tools they require.
# I'm happy to get involved with this CCP/project or any initiative it might lead on with. I'm passionate about data visualisation and have experience in developing such tools.
# Training on visualisation tools are really lacking. There should be more of them.
# More seminars to introduce what is available
# There is a strong need for web-based visualization methods to integrate into web-based applications we are developing.
# License sharing and advanced usage training
# Lack of tools limits the science we are able to achieve.
# Final note - Martin Turner at RAL is brilliant at cross promotion (between communities) and compiling enthusiastic newsletters and should be thoughtfully priased for his dedication to the subject. He and his team are successfully promoting they ideas that other communities are way ahead in.
# I'm not sure if Diamond are as involved as they could be. If they are it certainly isn't communicated well to Users.
# Many of the packages are great for visualization but quick mathematics (e.g. subtract two 3d data sets) requires recoding.

== Future results ==

There will be a six month review in Spring 2015 - but remember from the presentation "The user and viewer are always important"

@@ Line 1: / Line 1: @@
-Over 2014 the visualisation group, part of the Technology Division within SCD, has reconsidered the real visualisation needs of the computational sciences community. A series of informal and formal surveys are underway and the first ones have tackled the Tomographic Imaging and CFD (Computational Fluid Dynamics) communities. These wanted to find out which tools were actually being used and the best methods to support them.
+=Global Collaborative Computational Project (CCP) Survey results=
-A discussion video conferencing presentation occured just before Christmas 2014.
+Over 2014 the visualisation group, part of the Technology Division within SCD, has reconsidered the real visualisation needs of the computational sciences community. A series of informal and formal surveys are underway and the first small ones have tackled the Tomographic Imaging and CFD (Computational Fluid Dynamics) communities. These wanted to find out which tools were actually being used and the best methods to support them. A global CCP survey was also undertaken and a discussion video conferencing presentation for this occured just before Christmas 2014.
 [[File:Resbannerxmas_l.jpg|800px]]

@@ Line 129: / Line 129: @@
 * [[gnuplot]] - 5 replies
 * [[Materials Studio]] - 3 replies
-* [[Matlab]] - 3 replies, but is not discussed in this section as the responses are extremely similar to those in question 5.
+* [[MATLAB]] - 3 replies, but is not discussed in this section as the responses are extremely similar to those in question 5.
 * [[Paraview]] - 3 replies
 * [[PyMol]] - 3 replies, also not discussed here.

@@ Line 3: / Line 3: @@
 A discussion video conferencing presentation occured just before Christmas 2014.
-[[File:Resbannerxmas_l.jpg:800px]]
+[[File:Resbannerxmas_l.jpg|800px]]
 == Executive Summary ==

← Older revision		Revision as of 13:40, 30 January 2015
Line 1:		Line 1:
	Over 2014 the visualisation group, part of the Technology Division within SCD, has reconsidered the real visualisation needs of the computational sciences community. A series of informal and formal surveys are underway and the first ones have tackled the Tomographic Imaging and CFD (Computational Fluid Dynamics) communities. These wanted to find out which tools were actually being used and the best methods to support them.		Over 2014 the visualisation group, part of the Technology Division within SCD, has reconsidered the real visualisation needs of the computational sciences community. A series of informal and formal surveys are underway and the first ones have tackled the Tomographic Imaging and CFD (Computational Fluid Dynamics) communities. These wanted to find out which tools were actually being used and the best methods to support them.

		+	A discussion video conferencing presentation occured just before Christmas 2014.
		+
		+	[[File:Resbannerxmas_l.jpg:800px]]

	== Executive Summary ==		== Executive Summary ==

@@ Line 39: / Line 39: @@
 [[File:CCPSlide35.JPG|500px]]
-but the institution links allw us to see the extremely long tail that makes the statistics not a power law relationship.
+but the institution links allows us to see the extremely long tail that makes the statistics not a power law relationship.
 [[File:CCPSlide36.JPG|500px]]
@@ Line 56: / Line 56: @@
 [[File:CCPSlide39.JPG|500px]]
-The newer and therefore more current organisations have a larger response; with CCP5 and CCP9 being popular source code repositories and ISI an CLF being popular user communities.
+The newer and therefore more current organisations have a larger response; with CCP5 and CCP9 being popular source code repositories and ISIS and CLF being popular user communities.
 [[File:CCPSlide40.JPG|500px]]
@@ Line 91: / Line 91: @@
 [[File:CCPSlide47.JPG|500px]]
-This is lessradical when we also add thre 'occasional' used techniques.
+This is less radical when we also add the 'occasional' used techniques.
 [[File:CCPSlide48.JPG|500px]]
@@ Line 177: / Line 177: @@
 # Would be nice to have somebody looking into maintenance and support of useful tools and software.
 # Visualisation and application of calibrations to data go hand-in-hand together, thus the greatest visualisation tool won't be used much if it isn't integrated into a data handling flow. A good example is XCrysDen, which makes all the difference between just number crunching with wien2k and actually seeing what you're doing.
-# It would be great if the visulisation tool developers would start to collaborate to develop libraries, data formats etc that could be shared between them, to speed up the development of new tools and functionality, and allow users access to the full spectrum of tools they require.
+# It would be great if the visualisation tool developers would start to collaborate to develop libraries, data formats etc that could be shared between them, to speed up the development of new tools and functionality, and allow users access to the full spectrum of tools they require.
 # I'm happy to get involved with this CCP/project or any initiative it might lead on with. I'm passionate about data visualisation and have experience in developing such tools.
 # Training on visualisation tools are really lacking. There should be more of them.
@@ Line 184: / Line 184: @@
 # License sharing and advanced usage training
 # Lack of tools limits the science we are able to achieve.
-# Final note - Martin Turner at RAL is brilliant at cross promotion (between communities) and compiling enthusiastic newsletters and should be thoughtfully priased for his dedication to the subject. He and his team are successfully promoting they ideas that other communities are way ahead in.
+# Final note - Martin Turner at RAL is brilliant at cross promotion (between communities) and compiling enthusiastic newsletters and should be thoughtfully praised for his dedication to the subject. He and his team are successfully promoting they ideas that other communities are way ahead in.
 # I'm not sure if Diamond are as involved as they could be. If they are it certainly isn't communicated well to Users.
 # Many of the packages are great for visualization but quick mathematics (e.g. subtract two 3d data sets) requires recoding.

@@ Line 37: / Line 37: @@
 The wordle gives an indication of the distribution,
-[[CCPSlide35.JPG]]
+[[File:CCPSlide35.JPG|500px]]
 but the institution links allw us to see the extremely long tail that makes the statistics not a power law relationship.
-[[CCPSlide36.JPG|500px]]
+[[File:CCPSlide36.JPG|500px]]
 Zooming in we can see the individual major establishments.
-[[CCPSlide37.JPG|500px]]
+[[File:CCPSlide37.JPG|500px]]
@@ Line 54: / Line 54: @@
-[[CCPSlide39.JPG|500px]]
+[[File:CCPSlide39.JPG|500px]]
 The newer and therefore more current organisations have a larger response; with CCP5 and CCP9 being popular source code repositories and ISI an CLF being popular user communities.
-[[CCPSlide40.JPG|500px]]
+[[File:CCPSlide40.JPG|500px]]
@@ Line 66: / Line 66: @@
 Looking at the usage with both 'frequent' and 'essential' categories then we have the following curve.
-[[CCPSlide41.JPG|500px]]
+[[File:CCPSlide41.JPG|500px]]
 again we can zoom in and see in more detail the most popular tools.
-[[CCPSlide42.JPG|500px]]
+[[File:CCPSlide42.JPG|500px]]
 But removing the frequent and just looking at 'essential' tools the graph is very different and shows how different user communities use different tools.
-[[CCPSlide43.JPG|500px]]
+[[File:CCPSlide43.JPG|500px]]
 A wordle can also be useful to spot your favourite tools
-[[CCPSlide44.JPG|500px]]
+[[File:CCPSlide44.JPG|500px]]
 When asked about other tools there is an even longer tail to be found.
-[[CCPSlide45.JPG|500px]]
+[[File:CCPSlide45.JPG|500px]]
 The three most often used tools (gnuplot, MATLAB, Jmol) account for 26% of the responses and conversely, there is a tail of 31 packages that also accounts for 26% of the responses. Similarly the top four Essential tools (gnuplot, MATLAB, VMD, xmgrace) account for 42% of the responses. We need to ask why is there a long tail? Are there any useful features provided by the less popular tools that are not provided by gnuplot, MATLAB or Jmol? This is answered in the comments of questions 5 and 6.
@@ Line 89: / Line 89: @@
 Q4 What visualisation techniques are important to your work?
-[[CCPSlide47.JPG|500px]]
+[[File:CCPSlide47.JPG|500px]]
 This is lessradical when we also add thre 'occasional' used techniques.
-[[CCPSlide48.JPG|500px]]
+[[File:CCPSlide48.JPG|500px]]
 The most frequently used visualisation technique is to produce publication quality output. The facility to produce line graphs is equally important
@@ Line 149: / Line 149: @@
 We can combine the frequency of tools in Q5 and Q6 to produce an interesting frequency graph.
-[[CCPSlide54.JPG|500px]]
+[[File:CCPSlide54.JPG|500px]]
 Q7 Visualisation requirements. How important do you see the provision of the following (ed. Services)?
-[[CCPSlide55.JPG|500px]]
+[[File:CCPSlide55.JPG|500px]]
 Q8 Requirements for high performance/advanced visualisation facilities. Do you have any need for access to (ed Services)
-[[CCPSlide57.JPG|500px]]
+[[File:CCPSlide57.JPG|500px]]
 Q9 What do you see as the main challenges for visualisation in your domain now and in the near future?
-[[CCPSlide58.JPG|500px]]
+[[File:CCPSlide58.JPG|500px]]
 Q10 Any other comments?

@@ Line 29: / Line 29: @@
 == Survey Presentation ==
-Surprisingly, open source was not always the most important issue but the easy creation of plug-ins, new readers and writers, as well as analysis tools have been requested. �
+Surprisingly, open source was not always the most important issue but the easy creation of plug-ins, new readers and writers, as well as analysis tools have been requested.
 There was also indicated a strong growth in the use of the ParaView visualisation system (http://www.paraview.org/) that is an open source, multi-platform data analysis and visualisation application where users can build systems including adding qualitative and quantitative techniques.
@@ Line 35: / Line 35: @@
 Q1 Home institutions
-[[CCPSlide31.JPG|500px]]
+The wordle gives an indication of the distribution,
 Q2 Which CCP(s) are you involved with?
 Q3 What software do you use for visualisation of data?
 Q4 What visualisation techniques are important to your work?
 Q5 Comments on the respondents' most used visualisation tool.
 Q6 Same as question 5, for any other tool used.
 Q7 Visualisation requirements. How important do you see the provision of the following (ed. Services)?
 Q8 Requirements for high performance/advanced visualisation facilities. Do you have any need for access to (ed Services)
 Q9 What do you see as the main challenges for visualisation in your domain now and in the near future?
-[[CCPSlide31.JPG|500px]]
+[[CCPSlide58.JPG|500px]]
 Q10 Any other comments?