Microsoft Foundry Local AI (CLI)





  • Microsoft unveiled "Microsoft Foundry Local," allowing users to execute LLMs directly on their PCs.
  • The tool automates setup and optimizes PC performance for AI tasks.
  • Users can install and run models like "Phi-3.5-mini" using simple command-line inputs.
  • Local AI integrates seamlessly with Windows systems, reducing dependency on cloud-based AI services.
  • The system supports various hardware configurations, including GPUs for enhanced performance.

  1. Run PowerShell
  2. Execute this command:
    winget install Microsoft.FoundryLocal
  3. Run this model:
    foundry model run phi-3.5-mini
  4. List models:
    foundry model list

Reference: https://www.itworld.co.kr/article/3996223

No comments:

Powered by Blogger.