Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

General HPCC Systems core platform

Keyed Join fix for the remote handling of parts from othr clusters

When a smaller Thor was reading a file from a larger Thor where the larger Thor file overlapped, some slaves on the smaller cluster could find non-primary copies of the file locally. The effect of this was that other slaves would send requests to those local slaves, but did not map to the correct (non-primary) copy, resulting in a 'Failed to open' file error.

A workaround is to add this option:

#option('remoteKeyedLookup', false);

which forces all KJ part thread handlers to access the keyed parts directly.

https://track.hpccsystems.com/browse/HPCC-23163

Thor jobs locking up when using SMART join

...