Skip to content
View moosunny's full-sized avatar
  • Korea University, Savanna Lab
  • Seoul

Block or report moosunny

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
moosunny/README.md

πŸ‘‹ μ•ˆλ…•ν•˜μ„Έμš”, μ„±μž₯을 μ΅œμš°μ„  κ°€μΉ˜λ‘œ μ‚ΌλŠ” AI Engineer μ΅œλ¬΄μ„ μž…λ‹ˆλ‹€.

πŸ’‘ LLM 개발 κ²½ν—˜

  • LangGraph 기반 λ©€ν‹° μ—μ΄μ „νŠΈ μ‹œμŠ€ν…œμ„ 섀계 및 κ΅¬ν˜„ν•œ κ²½ν—˜μ΄ 있으며, λ³΅μž‘ν•œ μž‘μ—…μ„ μžλ™ν™”ν•˜λŠ” ν”„λ ˆμž„μ›Œν¬μ— 관심이 λ§ŽμŠ΅λ‹ˆλ‹€.
  • μ˜€ν”ˆ LLM을 ν™œμš©ν•œ 세이프티 필터링 λͺ¨λΈμ„ νŒŒμΈνŠœλ‹ν•˜μ—¬, μ‚¬μš©μžμ—κ²Œ μ•ˆμ „ν•œ 응닡을 μ œκ³΅ν•˜λŠ” μ‹œμŠ€ν…œμ„ κ΅¬μΆ•ν•œ κ²½ν—˜μ΄ μžˆμŠ΅λ‹ˆλ‹€.

πŸš€ λͺ¨λΈ 배포 및 운영

  • GCP 기반 인프라에 LLM을 λ°°ν¬ν•˜κ³ , 운영 ν™˜κ²½μ—μ„œ μ•ˆμ •μ μΈ μ„œλΉ„μŠ€λ₯Ό μ œκ³΅ν•΄ λ³Έ κ²½ν—˜μ΄ μžˆμŠ΅λ‹ˆλ‹€.
  • vLLM νŒŒλΌλ―Έν„° νŠœλ‹μ„ 톡해 μ œν•œλœ λ¦¬μ†ŒμŠ€ ν™˜κ²½μ—μ„œλ„ 효율적인 μΆ”λ‘  μ„±λŠ₯을 κ΅¬ν˜„ν–ˆμŠ΅λ‹ˆλ‹€.

πŸ“ˆ μ‹€μ‹œκ°„ λͺ¨λ‹ˆν„°λ§κ³Ό μ„±λŠ₯ μ΅œμ ν™”

  • Grafana + Prometheusλ₯Ό ν™œμš©ν•΄ λͺ¨λΈ μΆ”λ‘  ν™˜κ²½μ„ μ‹€μ‹œκ°„μœΌλ‘œ λͺ¨λ‹ˆν„°λ§ν•˜κ³ , 병λͺ© ꡬ간을 뢄석해 κ°œμ„ ν•œ κ²½ν—˜μ΄ μžˆμŠ΅λ‹ˆλ‹€.
  • 문제λ₯Ό λ‹¨μˆœνžˆ ν•΄κ²°ν•˜λŠ” 데 κ·ΈμΉ˜μ§€ μ•Šκ³ , κ·Όλ³Έ 원인을 λΆ„μ„ν•˜κ³  μž¬λ°œμ„ λ°©μ§€ν•˜λŠ” 것에 κ°€μΉ˜λ₯Ό λ‘‘λ‹ˆλ‹€.

πŸ› οΈ Tech Stacks

Python PyTorch Docker MySQL Notion


πŸ§‘β€πŸ’» Contact Me

Notion Gmail


πŸ… Stats

GitHub Stats Top Langs

Popular repositories Loading

  1. moosunny moosunny Public

    Config files for my GitHub profile.

    1

  2. moosunny.github.io moosunny.github.io Public

    HTML 1

  3. Algorithm-Study Algorithm-Study Public

    Python

  4. Graph-Neural-Networks-Practice Graph-Neural-Networks-Practice Public

    Jupyter Notebook

  5. 2024-K-AI-Manufacturing-Data-Analytics 2024-K-AI-Manufacturing-Data-Analytics Public

    Jupyter Notebook

  6. NLP-Practice NLP-Practice Public

    Jupyter Notebook