Pipe test case crashing with ioshape error

Just Starting
1

Dear PyFR developers,

I was wondering if you could help me with my test case. I have a modest OLCF
Summit allocation to test strong scaling of ACM for an internal flow simulation
and I am trying to set it up in PyFR using Loppi et al files.

My target geometry is a double elbow, but I am starting with a pipe. I am
attaching my gmsh and PyFR ini. I use

gmsh -o pipe.msh -f msh22 -3 pipe.geo

to mesh and then import and partition into 2 subdomains using PyFR. Running
with CUDA backend though gives me the following error

File "/ccs/proj/cfd141/apps/pyfr/1.10.0/pyfr/pyfr", line 112, in main
args.process(args)
File "/ccs/proj/cfd141/apps/pyfr/1.10.0/pyfr/pyfr", line 245, in process_run
args, NativeReader(args.mesh), None, Inifile.load(args.cfg)
...
File "/ccs/proj/cfd141/apps/pyfr/1.10.0/pyfr/solvers/base/system.py", line 193, in _gen_kernels
kernels[pn, kn].append(kgetter())
File "/ccs/proj/cfd141/apps/pyfr/1.10.0/pyfr/solvers/baseadvec/elements.py", line 61, in <lambda>
out=slicem(self._scal_fpts, s)
File "/ccs/proj/cfd141/apps/pyfr/1.10.0/pyfr/solvers/base/elements.py", line 131, in _slice_mat
if len(mat.ioshape) >= 3:
AttributeError: 'CUDAMatrixSlice' object has no attribute 'ioshape'

I am attaching my geo and ini file. Please let me know if anything strikes you.
My guess is that I am still messing something up with the mesh.

Best wishes,
Robert

error.txt (2.67 KB)

pipe.geo (5.7 KB)

incompressible.ini (1.3 KB)

2

Hi Robert,

Can you try removing the div-flux option from the anti-alias directive?
This is a piece of functionality we've removed in the most recent
version of PyFR.

Regards, Freddie.

3

Thanks Freddie. Yes. That was precisely the problem. It's running now and I
should have mentioned that I am trying 1.10 version.

I will play with other options now.

Best wishes,
Robert

4

Freddie,

Unfortunately, I seem to be producing lots of NaNs almost immediately. Is there
anything else in this Loppi setting that needs to be updated?

Also, I've used progressive mesh refinement for near wall region. Is that
something that could lead to NaNs? Should I go back to more uniform cell size?

Best wishes,
Robert

5

PS. Scratch that. After playing with the parameters I seem to be producing some
correct behaviour for the pipe. I will run a bit more thorough tests and
report.