tdhook.weights.adapters

Classes

HookedModuleWithAdapters	Wrapper to enhance a module with hooking capabilities.
Adapters	ROME [28], sparse autoencoders [29] and transcoders [30].

Module Contents

class tdhook.weights.adapters.HookedModuleWithAdapters(*args, adapters, **kwargs)

Bases: tdhook.modules.HookedModule

Wrapper to enhance a module with hooking capabilities.

Parameters:

adapters (Dict[str, torch.nn.Module])

adapters

class tdhook.weights.adapters.Adapters(adapters, cache_callback=None, relative=True, directions=None, cache=None, clear_cache=True)

Bases: tdhook.contexts.HookingContextFactory

ROME [28], sparse autoencoders [29] and transcoders [30].

Parameters:

• adapters (Dict[str, Tuple[torch.nn.Module, str, str]])

• cache_callback (Optional[Callable])

• relative (bool)

• directions (Optional[List[tdhook.hooks.HookDirection]])

• cache (Optional[tensordict.TensorDict])

• clear_cache (bool)

_hooked_module_class

_hooking_context_class

_adapters

_cache_callback = None

_relative = True

_directions = ['fwd']

_hook_module(module)

Parameters:

module (tdhook.modules.HookedModule)

Return type:

tdhook.hooks.MultiHookHandle