0.16.0
✨ Highlights ✨
HSTU architecture from "Actions Speak Louder then Words..." is now available in RecTools as HSTUModel, fully compatible with our fit / recommend paradigm and capable of context-aware recommendations.
Added
- HSTU Model from "Actions Speak Louder then Words..." implemented in the class
HSTUModel(#290) leave_one_out_maskfunction (rectools.models.nn.transformers.utils.leave_one_out_mask) for applying leave-one-out validation during transformer models training.(#292)logits_targument toTransformerLightningModuleBase. It is used to scale logits when computing the loss. (#290)use_scale_factorargument toLearnableInversePositionalEncoding. It scales embeddings by the square root of their dimension — following the original approach from the "Attention Is All You Need" (#290)- Optional
contextargument torecommendmethod of models andget_contextfunction torectools.dataset.context.py(#290)
Fixed
- [Breaking] Corrected computation of
cosinedistance inDistanceSimilarityModule(#290) - Installation issue with
cupyextra on macOS (#293) torch.dtype object has no attribute 'kind'error inTorchRanker(#293)
Removed
- [Breaking]
Dropoutmodule fromIdEmbeddingsItemNet. This changes model behaviour during training, so model results starting from this release might slightly differ from previous RecTools versions even when the random seed is fixed.(#290)