IOSS 2.0
Loading...
Searching...
No Matches
Ioss_Doxygen.h
Go to the documentation of this file.
1
2// clang-format off
3
4/*! \mainpage IOSS API Documentation
5
6\section avail Availability
7
8The IOSS library source code is available on Github at
9https://github.com/sandialabs/seacas
10
11For bug reports, documentation errors, and enhancement suggestions, contact:
12- WEB: https://github.com/sandialabs/seacas (external/internal)
13- EMAIL: sierra-help@sandia.gov (internal)
14
15\section db_types Database Types
16
17The IOSS system supports multiple database formats. The default format is the Sandia-developed Exodus format. The list below shows all supported
18database input and/or output formats. Not all of these may be available on all builds; the supported databases on a particular installation can be
19determined by running the `io_info --config` program.
20
21Type | Input/Output | Description
22-----------------|---------------|--------------------------
23exodus | Input/Output | Sandia-developed database system for unstructured mesh input/output (https://sandialabs.github.io/seacas-docs/sphinx/html/index.html#exodus-library)
24cgns | Input/Output | CFD General Notation System (https://cgns.github.io/)
25generated | Input | Generate an unstructured hex/shell mesh using a token string (Iogn::GeneratedMesh::GeneratedMesh)
26textmesh | Input | Generate an unstructured mesh using a token string
27heartbeat | Output | A text based output for global values
28pamgen | Input | (https://trilinos.github.io/pamgen.html)
29gen_struc | Input | Generate a structured mesh using a token string (IxJxK)
30catalyst_exodus | Output | Visualization pipeline, exodus-based
31catalyst_cgns | Output | Visualization pipeline, cgns-based
32null | Output | No data written to disk, no calculations done by ioss
33exonull | Output | No data written to disk, but uses all of the exodus io database infrastructure/calculations
34adios | Input/Output | Adaptable Input/Output system, (https://adios2.readthedocs.io/en/latest/)
35faodel | Input/Output | (https://github.com/faodel/faodel)
36exodusii | Input/Output | alias for exodus
37genesis | Input/Output | alias for exodus
38par_cgns | Input/Output | alias for parallel CGNS
39
40\section properties Properties
41
42## General Properties
43
44 Property | Value | Description
45 ----------|:--------:|------------
46 LOGGING | on/[off] | enable/disable logging of field input/output
47 LOWERCASE_VARIABLE_NAMES | [on]/off | Convert all variable names read from input database to lowercase; replace ' ' with '_'
48 LOWERCASE_DATABASE_NAMES | on/[off] | Convert all block/set names read from input database to lowercase; replace ' ' with '_'
49 USE_GENERIC_CANONICAL_NAMES | on/[off] | use `block_{id}` as canonical name of an element block instead of the name (if any) stored on the database. The database name will be an alias.
50 IGNORE_DATABASE_NAMES | on/[off] | Do not read any element block, nodeset, ... names if they exist on the database. Use only the canonical generated names (entitytype + _ + id)
51 IGNORE_ATTRIBUTE_NAMES | on/[off] | Do not read the attribute names that may exist on an input database. Instead for an element block with N attributes, the fields will be named `attribute_1` ... `attribute_N`
52 MINIMIZE_OPEN_FILES | on/[off] | If on, then close file after each timestep and then reopen on next output
53 SERIALIZE_IO | integer | The number of files that will be read/written to simultaneously in a parallel file-per-rank run.
54
55## Auto-Decomposition-Related Properties
56
57 Property | Value | Description
58-----------------|:------:|-----------------------------------------------------------
59MODEL_DECOMPOSITION_METHOD | {method} | Decompose a DB with type `MODEL` using `method`
60RESTART_DECOMPOSITION_METHOD | {method} | Decompose a DB with type `RESTART_IN` using `method`
61DECOMPOSITION_METHOD | {method} | Decompose all input DB using `method`
62PARALLEL_CONSISTENCY | [on]/off | On if the client will call Ioss functions consistently on all processors. If off, then the auto-decomp and auto-join cannot be used.
63RETAIN_FREE_NODES | [on]/off | In auto-decomp, will nodes not connected to any elements be retained.
64LOAD_BALANCE_THRESHOLD | {real} [1.4] | CGNS-Structured only -- Load imbalance permitted Load on Proc / Avg Load
65DECOMPOSITION_EXTRA | {name},{multiplier} | Specify the name of the element map or variable used if the decomposition method is `map` or `variable`. If it contains a comma, the value following the comma is used to scale (divide) the values in the map/variable. If it is 'auto', then all values will be scaled by `max_value/processorCount`
66DECOMP_OMITTED_BLOCK_IDS | {id_list} | A integer vector containing the element block ids that should be ignored during the parallel decomposition. The blocks will still appear in the decomposition, but will not affect the load balance. If specified via `IOSS_PROPERTIES` can be a comma-separated string of ids.
67DECOMP_OMITTED_BLOCK_NAMES | {name_list} | A comma-separated list of block names that should be ignored during the parallel decomposition. The blocks will still appear in the decomposition, but will not affect the load balance.
68
69### Valid values for Decomposition Method
70
71Method | Description
72:---------:|-------------------
73rcb | recursive coordinate bisection
74rib | recursive inertial bisection
75hsfc | hilbert space-filling curve
76metis_sfc | metis space-filling-curve
77kway | metis kway graph-based
78kway_geom | metis kway graph-based method with geometry speedup
79linear | elements in order first n/p to proc 0, next to proc 1.
80cyclic | elements handed out to id % proc_count
81random | elements assigned randomly to processors in a way that preserves balance (do not use for a real run)
82map | the specified element map contains the mapping of elements to processor. Uses 'processor_id' map by default; otherwise specify name with `DECOMPOSITION_EXTRA` property
83variable | the specified element variable contains the mapping of elements to processor. Uses 'processor_id' variable by default; otherwise specify name with `DECOMPOSITION_EXTRA` property
84external | Files are decomposed externally into a file-per-processor in a parallel run.
85
86## Output File Composition -- Single File output from parallel run instead of file-per-processor
87
88 Property | Value
89-----------------|:------:
90COMPOSE_RESTART | on/[off]
91COMPOSE_RESULTS | on/[off]
92PARALLEL_IO_MODE | netcdf4, hdf5, pnetcdf, (mpiio and mpiposix are deprecated)
93
94## Properties Related to byte size of reals and integers
95
96 Property | Value | Description
97-----------------------|:------:|-----------------------------------------------------------
98 INTEGER_SIZE_DB | [4] / 8 | byte size of integers stored on the database.
99 INTEGER_SIZE_API | [4] / 8 | byte size of integers used in api functions.
100 REAL_SIZE_DB | 4 / [8] | byte size of floating point stored on the database.
101 REAL_SIZE_API | 4 / [8] | byte size of floating point used in api functions.
102
103## Properties related to field and sideset/surface interpretation
104 Property | Value | Description
105--------------------------|:--------:|-----------------------------------------------------------
106 ENABLE_FIELD_RECOGNITION | [on]/off | Does the IOSS library combine scalar fields into higher-order fields (tensor, vector) based on suffix interpretation.
107 IGNORE_REALN_FIELDS | [off]/on | Do not recognize var_1, var_2, ..., var_n as an n-component field. Keep as n scalar fields. Currently ignored for composite fields.
108 FIELD_SUFFIX_SEPARATOR | char / '_'| The character that is used to separate the base field name from the suffix. Default is underscore.
109 FIELD_STRIP_TRAILING_UNDERSCORE | on / [off] | If `FIELD_SUFFIX_SEPARATOR` is empty and there are fields that end with an underscore, then strip the underscore. (`a_x`, `a_y`, `a_z` is vector field `a`).
110 IGNORE_ATTRIBUTE_NAMES | on/[off] | Do not read the attribute names that may exist on an input database. Instead for an element block with N attributes, the fields will be named `attribute_1` ... `attribute_N`
111 SURFACE_SPLIT_TYPE | {type} | Specify how to split sidesets into homogeneous sideblocks. Either an integer or string: 1 or `TOPOLOGY`, 2 or `BLOCK`, 3 or `NO_SPLIT`. Default is `TOPOLOGY` if not specified.
112 DUPLICATE_FIELD_NAME_BEHAVIOR | {behavior} | Determine how to handle duplicate incompatible fields on a database. Valid values are `IGNORE`, `WARNING`, or `ERROR` (default). An incompatible field is two or more fields with the same name, but different sizes or roles or types.
113 OUTPUT_FIELD_METADATA | on/[off] | Should the enhanced field metadata attributes be used for output.
114## Output Database-Related Properties
115 Property | Value | Description
116-----------------|:------:|-----------------------------------------------------------
117 OMIT_QA_RECORDS | on/[off] | Do not output any QA records to the output database.
118 OMIT_INFO_RECORDS | on/[off] | Do not output any INFO records to the output database.
119 RETAIN_EMPTY_BLOCKS | on/[off] | If an element block is completely empty (on all ranks) should it be written to the output database.
120 VARIABLE_NAME_CASE | upper/lower | Should all output field names be converted to uppercase or lowercase. Default is leave as is.
121 FILE_TYPE | [netcdf], netcdf4, netcdf-4, hdf5 | Underlying file type (bits on disk format)
122 COMPRESSION_METHOD | [zlib], szip, zstd, bzip2 | The compression method to use. `szip`, `zstd`, and `bzip2` only available if HDF5 is built with that supported.
123 COMPRESSION_LEVEL | [0]-9 | If zlib: In the range [0..9]. A value of 0 indicates no compression, will automatically set `file_type=netcdf4`, recommend <=4
124 COMPRESSION_LEVEL | 4-32 | If szip: An even number in the range 4-32, will automatically set `file_type=netcdf4`.
125 COMPRESSION_SHUFFLE | on/[off] |to enable/disable hdf5's shuffle compression algorithm.
126 COMPRESSION_QUANTIZE_NSD | 1-15 | Use the lossy quantize compression method. Value specifies number of digits to retain. [exodus only])
127 MAXIMUM_NAME_LENGTH | [32] | Maximum length of names that will be returned/passed via api call.
128 APPEND_OUTPUT | on/[off] | Append output to end of existing output database
129 APPEND_OUTPUT_AFTER_STEP | {step}| Max step to read from an input db or a db being appended to (typically used with APPEND_OUTPUT)
130 APPEND_OUTPUT_AFTER_TIME | {time}| Max time to read from an input db or a db being appended to (typically used with APPEND_OUTPUT)
131 FILE_PER_STATE | on/[off] | Put data for each output timestep into a separate file.
132 CYCLE_COUNT | {cycle} | If using FILE_PER_STATE, then use {cycle} different files and then overwrite. Otherwise, there will be a maximum of {cycle} time steps in the file. See below.
133 OVERLAY_COUNT | {overlay}| If using FILE_PER_STATE, then put {overlay} timesteps worth of data into each file before going to next file. Otherwise, each output step in the file will be overwritten {overlay} times. See below.
134 ENABLE_DATAWARP | on/[off] | If the system supports Cray DataWarp (burst buffer), should it be used for buffering output files.
135## Deprecated Database-Related Properties
136 Property | Value | Description
137-----------------|:------:|-----------------------------------------------------------
138 LOWER_CASE_VARIABLE_NAMES | [on]/off | Use LOWERCASE_VARIABLE_NAMES
139 LOWER_CASE_DATABASE_NAMES | on/[off] | Use LOWERCASE_DATABASE_NAMES
140
141### Cycle and Overlay Behavior:
142(Properties `CYCLE_COUNT`, `OVERLAY_COUNT`, and `FILE_PER_STATE`)
143The `overlay` specifies the number of output steps which will be
144overlaid on top of the currently written step before advancing to the
145next step on the database.
146
147For example, if output every 0.1 seconds and the overlay count is
148specified as 2, then IOSS will write time 0.1 to step 1 of the
149database. It will then write 0.2 and 0.3 also to step 1. It will
150then increment the database step and write 0.4 to step 2 and overlay
1510.5 and 0.6 on step 2. At the end of the analysis, (assuming it runs
152to completion), the database would have times 0.3, 0.6, 0.9,
153... However, if there were a problem during the analysis, the last
154step on the database would contain an intermediate step.
155
156The `cycle_count` specifies the number of restart steps which will be
157written to the restart database before previously written steps are
158overwritten. For example, if the `cycle` count is 5 and output is
159written every 0.1 seconds, IOSS will write data at times 0.1, 0.2,
1600.3, 0.4, 0.5 to the database. It will then overwrite the first step
161with data from time 0.6, the second with time 0.7. At time 0.8, the
162database would contain data at times 0.6, 0.7, 0.8, 0.4, 0.5. Note
163that time will not necessarily be monotonically increasing on a
164database that specifies the cycle count.
165
166The cycle count and overlay count can both be used at the same time
167also. The basic formula is:
168```
169 db_step = (((output_step - 1) / overlay) % cycle) + 1
170```
171where `output_step` is the step that this would have been on the
172database in a normal write (1,2,3,....) and `db_step` is the step
173number that this will be written to.
174
175If you only want the last step available on the database,
176use `set_cycle_count(1)`.
177
178If `FILE_PER_STATE` is specified, then `cycle` specifies the number of
179separate files which will be created and `overlay` specifies how many
180timesteps will be written to each file. If we have `cycle=2` and
181`overlay=3` and the code is outputting every 0.1 seconds, we will get
1820.1, 0.2, 0.3 in the first file; 0.4, 0.5, 0.6 in the second
183file. Then, the first file will be reopened and steps 0.7, 0.8, and
1840.9 will be written to the first file.
185
186
187## Properties for the heartbeat output
188 Property | Value | Description
189-----------------------|:------:|-----------------------------------------------------------
190 FILE_FORMAT | [default], spyhis, csv, ts_csv, text, ts_text | predefined formats for heartbeat output. The ones starting with `ts_` output timestamps.
191 FLUSH_INTERVAL | int | Minimum time interval between flushing heartbeat data to disk. Default is 10 seconds. Set to 0 to flush every step (bad performance)
192 HEARTBEAT_FLUSH_INTERVAL | int | Minimum time interval between flushing heartbeat data to disk. Default is 10 seconds (Same as FLUSH_INTERVAL, but doesn't affect other database types)
193 TIME_STAMP_FORMAT | [%H:%M:%S] | Format used to format time stamp. See strftime man page
194 SHOW_TIME_STAMP | on/off | Should the output lines be preceded by the timestamp
195 FIELD_SEPARATOR | [, ] | separator to be used between output fields.
196 FULL_PRECISION | on/[off] | output will contain as many digits as needed to fully represent the doubles value. FIELD_WIDTH will be ignored for doubles if this is specified.
197 PRECISION | -1..16 [5] | Precision used for floating point output. If set to `-1`, then the output will contain as many digits as needed to fully represent the doubles value. FIELD_WIDTH will be ignored for doubles if precision is set to -1.
198 FIELD_WIDTH | 0.. | Width of an output field. If 0, then use natural width.
199 SHOW_LABELS | on/[off] | Should each field be preceded by its name (ke=1.3e9, ie=2.0e9)
200 SHOW_LEGEND | [on]/off | Should a legend be printed at the beginning of the output showing the field names for each column of data.
201 SHOW_TIME_FIELD | on/[off] | Should the current analysis time be output as the first field.
202
203## Experimental / Special Purpose
204
205 Property | Value | Description
206-----------------------|:------:|-----------------------------------------------------------
207MEMORY_READ | on/[off] | experimental. Read a file into memory at open time, operate on it without disk accesses.
208MEMORY_WRITE | on/[off] | experimental. Open and read a file into memory or create and optionally write it back out to disk when nc_close() is called.
209ENABLE_FILE_GROUPS | on/[off] | experimental. Opens database in netcdf-4 non-classic mode which is what is required to support groups at netCDF level.
210MINIMAL_NEMESIS_INFO | on/[off] | special case, omit all nemesis data except for nodal communication map
211OMIT_EXODUS_NUM_MAPS | on/[off] | special case, do not output the node and element numbering map.
212IGNORE_NODE_MAP | [on/[off] | do not read the node map from the input database
213IGNORE_EDGE_MAP | [on/[off] | do not read the edge map from the input database
214IGNORE_FACE_MAP | [on/[off] | do not read the face map from the input database
215IGNORE_ELEM_MAP | [on/[off] | do not read the element map from the input database
216EXODUS_CALL_GET_ALL_TIMES| [on] / off | special case -- should the `ex_get_all_times()` function be called. See below.
217
218* `EXODUS_CALL_GET_ALL_TIMES`: Typically only used in `isSerialParallel`
219mode and the client is responsible for making sure that the step times
220are handled correctly. All databases will know about the number of
221timesteps, but if the `ex_get_all_times()` function call is skipped, then
222the times on that database will all be zero. The use case is that in `isSerialParallel`,
223each call to `ex_get_all_times()` for all files is performed
224sequentially, so if you have hundreds to thousands of files, the time
225for the call is additive and since timesteps are record variables in
226netCDF, accessing the data for all timesteps involves lseeks
227throughout the file.
228
229
230## Debugging / Profiling
231
232 Property | Value | Description
233 ----------|:--------:|------------
234 LOGGING | on/[off] | enable/disable logging of field input/output
235 ENABLE_TRACING | on/[off] | show memory and elapsed time during some IOSS calls (mainly decomp).
236 DECOMP_SHOW_PROGRESS | on/[off] | use `ENABLE_TRACING`.
237 DECOMP_SHOW_HWM | on/[off] | show high-water memory during autodecomp
238 IOSS_TIME_FILE_OPEN_CLOSE | on/[off] | show elapsed time during parallel-io file open/close/create/flush
239 CHECK_PARALLEL_CONSISTENCY | on/[off] | check Ioss::GroupingEntity parallel consistency
240 TIME_STATE_INPUT_OUTPUT | on/[off] | show the elapsed time for reading/writing each timestep's data
241 NAN_DETECTION | on/[off] | Output a warning if a NaN is detected while reading/writing field data.
242
243## Setting properties via an environment variable
244
245Although the properties are usually accessed internally in the
246application calling the IOSS library, it is possible to set the
247properties externally prior to running the application via the setting
248of the environment variable `IOSS_PROPERTIES`. The value of the
249variable is one or more colon-separated property/property-value pairs.
250For example, to set the `DECOMPOSITION_METHOD` and the `FILE_TYPE`
251externally, the following would be used:
252```
253 export IOSS_PROPERTIES="DECOMPOSITION_METHOD=rib:FILE_TYPE=netcdf4"
254```
255If the environment variable is set correctly, there should be an
256informational message output during running of the application similar
257to:
258```
259 IOSS: Adding property 'DECOMPOSITION_METHOD' with value 'rib'
260 IOSS: Adding property 'FILE_TYPE' with value 'netcdf4'
261```
262
263\section license License
264The IOSS library is licensed under the BSD open source license.
265
266 Copyright(C) 1999-2021 National Technology & Engineering Solutions
267 of Sandia, LLC (NTESS). Under the terms of Contract DE-NA0003525 with
268 NTESS, the U.S. Government retains certain rights in this software.
269
270 See packages/seacas/LICENSE for details
271
272 Redistribution and use in source and binary forms, with or without
273 modification, are permitted provided that the following conditions are
274 met:
275
276 * Redistributions of source code must retain the above copyright
277 notice, this list of conditions and the following disclaimer.
278
279 * Redistributions in binary form must reproduce the above
280 copyright notice, this list of conditions and the following
281 disclaimer in the documentation and/or other materials provided
282 with the distribution.
283
284 * Neither the name of NTESS nor the names of its
285 contributors may be used to endorse or promote products derived
286 from this software without specific prior written permission.
287
288 THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
289 "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
290 LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
291 A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
292 OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
293 SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
294 LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
295 DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
296 THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
297 (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
298 OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
299
300*/
301
302// clang-format on