mailRe: [task #7860] When dx_map is issued, create a parameter file which maps parameters to chi2 value.


Others Months | Index by Date | Thread Index
>>   [Date Prev] [Date Next] [Thread Prev] [Thread Next]

Header


Content

Posted by Edward d'Auvergne on October 13, 2014 - 09:47:
Hi Troels,

It is actually not so difficult to reconstruct this text file from the
OpenDX data files, if you know the parameter bounds used in the dx.map
user function call.  However if you would like it automatically
created, then this must be as an option.  The aim of the dx.map user
function is to create the input files for OpenDX to visualise a map of
the space.  Your proposed text file is additional functionality on top
of this, which is not required for the primary purpose.  For good
design, additional features should be made as an option that the user
chooses to have or not have.  And the default is that additional
features are off.

I will give you an example whereby this feature is highly undesired.
In my original work on model-free model selection:

    d'Auvergne, E. J. and Gooley, P. R. (2003). The use of model
selection in the model-free analysis of protein dynamics. J. Biomol.
NMR, 25(1), 25-39. (http://dx.doi.org/10.1023/A:1021902006114)

This work involved a mass screening of the entire model-free parameter
space.  I created two 3D grids covering all of the space for two
different types of motion.  Then for each grid point, I took those
parameter values and back-calculated the relaxation data.  I then
generated full OpenDX maps for each grid point and, as this map is
itself a grid, the total data content is essentially the grid squared!
 All the data files generated, even after bzip2 compression took up
many, many gigabytes.  It was too big for the hard disk in my
computer, so I had to burn it off onto 40+ CDs.  In this analysis I
also performed optimisation and model selection, and created
additional OpenDX maps via external scripting for the figures in that
paper.

The point is that had these additional files been created, as they
contain 4 times the number of floating point numbers as the DX data
file, they would have increased this size by 5.  That would have make
the analysis totally infeasible.  In such cases, which I will probably
encounter again in the future, your proposed text files will make this
type of mass screening impossible.  Therefore, if you would like this,
it really must be activated by a new Boolean argument to the user
function which defaults to False.

Cheers,

Edward



On 10 October 2014 15:29, Troels Emtekær Linnet <tlinnet@xxxxxxxxxxxxx> wrote:
So, when creating a dx map, you get a nice image.

If a text file where to provide the mapping of chi2 values from the
parameters, you would get a better feeling with the parameters.

So, this i just a possibility to examine the dx_map creation.

This is what I am after.

Best
Troels

2014-10-10 15:02 GMT+02:00 Edward d'Auvergne <edward@xxxxxxxxxxxxx>:

Hi,

Then I would suggest something much more powerful!  The dx.map user
function is currently only for 3 dimensions or parameters, so it is
rather useless for looking for a global minimum if the parameter
values of the other dimensions are not set to the values of that
unknown minimum!

I would therefore suggest a much, much more powerful user function
that will be very quick for you to implement.  It could be called
maybe the minimise.grid_map or minimise.map_space user function.  You
can create this by simple duplication of the minimise.grid_search user
function code, but just add a new argument for an output text file.
Then you set up your target function and loop over the parameter space
yourself (by first creating a massive parameter grid) and then calling
the target function and placing the returned chi2 value into the text
file.  As your dimensions are not limited - though you could extend it
so you only use a subset of parameters just as in the dx.map user
function - you will be able to see much more of the space.  Is this
what you would be after?

Regards,

Edward


On 10 October 2014 14:50, Troels Emtekær Linnet <tlinnet@xxxxxxxxxxxxx>
wrote:
Hi Edward.

The reason I am looking into this, is that I maybe have some maps which
shows that relax did not find the global minimum.

So, I look into my data, and will create the files for inspection.

Best
Troels

2014-10-10 14:33 GMT+02:00 Edward d Auvergne
<NO-REPLY.INVALID-ADDRESS@xxxxxxx>:

Follow-up Comment #2, task #7860 (project relax):

Using the 'map_type', and adding a new section 'plain text', then this
could
be extended to map out 4, 5, or much higher dimensions as well.  This
could
almost be a new user function though, as half of the dx.map user
function
options will not be used.

    _______________________________________________________

Reply to this item at:

  <http://gna.org/task/?7860>

_______________________________________________
  Message sent via/by Gna!
  http://gna.org/







Related Messages


Powered by MHonArc, Updated Mon Oct 13 10:40:11 2014