{"id":18652,"date":"2025-07-22T00:55:21","date_gmt":"2025-07-22T04:55:21","guid":{"rendered":"http:\/\/nycphantom.com\/journal\/?p=18652"},"modified":"2025-07-22T00:55:21","modified_gmt":"2025-07-22T04:55:21","slug":"running-llm-locally","status":"publish","type":"post","link":"http:\/\/nycphantom.com\/journal\/?p=18652","title":{"rendered":"Running LLM Locally"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">In order to learn the AI hype such as ChatGPT today, a start would be to run LLM locally. <a href=\"https:\/\/www.technologyreview.com\/2025\/07\/17\/1120391\/how-to-run-an-llm-on-your-laptop\/\" data-type=\"link\" data-id=\"https:\/\/www.technologyreview.com\/2025\/07\/17\/1120391\/how-to-run-an-llm-on-your-laptop\/\">MIT published<\/a> this article on doing <strong>LLM on a laptop<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/evanhahn.com\/local-llms-versus-offline-wikipedia\/?utm_source=tldrwebdev\">Someone compares<\/a> the storage needed to run these with having offline Wikipedia, which is quite comparable.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In order to learn the AI hype such as ChatGPT today, a start would be to run LLM locally. MIT published this article on doing LLM on a laptop. Someone compares the storage needed to run these with having offline &hellip; <a href=\"http:\/\/nycphantom.com\/journal\/?p=18652\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[42],"tags":[],"class_list":["post-18652","post","type-post","status-publish","format-standard","hentry","category-computer-science"],"_links":{"self":[{"href":"http:\/\/nycphantom.com\/journal\/index.php?rest_route=\/wp\/v2\/posts\/18652","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/nycphantom.com\/journal\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/nycphantom.com\/journal\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/nycphantom.com\/journal\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/nycphantom.com\/journal\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=18652"}],"version-history":[{"count":1,"href":"http:\/\/nycphantom.com\/journal\/index.php?rest_route=\/wp\/v2\/posts\/18652\/revisions"}],"predecessor-version":[{"id":18653,"href":"http:\/\/nycphantom.com\/journal\/index.php?rest_route=\/wp\/v2\/posts\/18652\/revisions\/18653"}],"wp:attachment":[{"href":"http:\/\/nycphantom.com\/journal\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=18652"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/nycphantom.com\/journal\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=18652"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/nycphantom.com\/journal\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=18652"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}