Skip to content
This repository was archived by the owner on Aug 26, 2022. It is now read-only.

v1.1
Compare
Choose a tag to compare
@hyunwoongko hyunwoongko released this 29 Dec 22:48
· 804 commits to master since this release
v1.1
0fa0241

[#3] Add deployment launcher of Parallelformers into OSLO.

from oslo import GPTNeoForCausalLM

model = GPTNeoForCausalLM.from_pretrained_with_parallel(
    "EleutherAI/gpt-neo-2.7B",
    tensor_parallel_size=2,
    pipeline_parallel_size=2,
    deployment=True  # <-- new feature !
)

You can easily use deployment launcher by deployment=True. Please refer to USAGE.md for more details.

Assets 2
Loading