If baryta has an affinity to hypo thus it's baryta that it's most difficult to wash thoroughly. if this is the case, then gelatine which of course benefits from alkaline fixer should be our second concern - it's probably properly washed out long before the baryta is. Regardless of the fixer type.