Are we tiny?#
gptme is intended to be small and simple, and focus on doing the right thing in the right way, rather than all the things in all the ways.
The benefits of this approach are many:
It is easier to understand and maintain.
It is easier to contribute to.
It is easier to learn.
It is easier to extend.
It is more fun to work on.
Being aggressive about keeping things small and simple is a way to keep the project maintainable and fun to work on. The fastest way to kill a project is to make it too big and complex, and suffer burnout as a result.
Another major benefit of keeping things small and simple is that it makes it easier for AI to understand and work with the codebase. This is a major goal of the project, and it is important to keep in mind that the simpler the codebase is, the easier it will be for AI to work with it:
“The simpler your API is, the more effectively the AI can harness it when generating code.”
—Kenneth Reitz (and many others)
To that end, in this document we will present some statistics about the current state of the project, trying to be mindful to keep an eye on this page and make sure we are not growing too much.
Startup time#
$ make bench-importtime
...
602952 | gptme.llm
856044 | gptme.commands
860574 | gptme.chat
878023 | gptme.cli
934975 | gptme
real 0m1.896s
user 0m1.616s
sys 0m0.298s
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
Lines of code#
LoC Core#
$ make cloc-core
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/*.py gptme/llm/*.py gptme/util/*.py gptme/tools/__init__.py gptme/tools/base.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.07 s (534.7 files/s, 130188.8 lines/s)
---------------------------------------------------------------------------------
File blank comment code
---------------------------------------------------------------------------------
gptme/llm/llm_anthropic.py 92 74 418
gptme/llm/llm_openai.py 97 52 392
gptme/config.py 110 69 363
gptme/tools/base.py 89 78 355
gptme/util/context.py 96 137 350
gptme/logmanager.py 75 66 328
gptme/cli.py 57 56 314
gptme/util/prompt.py 76 98 293
gptme/chat.py 49 55 268
gptme/llm/models.py 36 17 260
gptme/message.py 60 65 241
gptme/prompts.py 71 90 241
gptme/commands.py 23 22 240
gptme/ncurses.py 39 5 238
gptme/llm/__init__.py 56 51 236
gptme/util/ask_execute.py 53 46 203
gptme/util/cli.py 51 31 174
gptme/tools/__init__.py 55 33 161
gptme/util/__init__.py 37 22 158
gptme/llm/llm_openai_models.py 2 10 138
gptme/util/export.py 17 25 86
gptme/init.py 25 19 76
gptme/util/reduce.py 24 32 75
gptme/util/generate_name.py 5 6 69
gptme/codeblock.py 13 10 64
gptme/dirs.py 27 14 55
gptme/__version__.py 9 7 45
gptme/util/cost.py 12 20 43
gptme/util/clipboard.py 8 2 35
gptme/util/terminal.py 23 21 34
gptme/wut.py 13 12 31
gptme/util/useredit.py 12 13 21
gptme/util/interrupt.py 13 14 20
gptme/constants.py 7 11 13
gptme/__init__.py 1 0 8
gptme/__main__.py 1 0 3
---------------------------------------------------------------------------------
SUM: 1434 1283 6049
---------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC LLM#
$ make cloc-llm
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/llm/*.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.02 s (277.3 files/s, 107081.3 lines/s)
---------------------------------------------------------------------------------
File blank comment code
---------------------------------------------------------------------------------
gptme/llm/llm_anthropic.py 92 74 418
gptme/llm/llm_openai.py 97 52 392
gptme/llm/models.py 36 17 260
gptme/llm/__init__.py 56 51 236
gptme/llm/llm_openai_models.py 2 10 138
---------------------------------------------------------------------------------
SUM: 283 204 1444
---------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC Tools#
$ make cloc-tools
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/tools/*.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.04 s (537.2 files/s, 135430.1 lines/s)
-------------------------------------------------------------------------------------
File blank comment code
-------------------------------------------------------------------------------------
gptme/tools/computer.py 150 218 436
gptme/tools/base.py 89 78 355
gptme/tools/tts.py 121 136 321
gptme/tools/shell.py 74 68 317
gptme/tools/tmux.py 52 72 211
gptme/tools/save.py 44 43 205
gptme/tools/patch.py 44 60 195
gptme/tools/_browser_playwright.py 60 20 185
gptme/tools/python.py 56 49 172
gptme/tools/__init__.py 55 33 161
gptme/tools/chats.py 43 49 142
gptme/tools/rag.py 63 75 141
gptme/tools/mcp_adapter.py 31 23 131
gptme/tools/subagent.py 37 29 103
gptme/tools/_browser_thread.py 20 3 97
gptme/tools/browser.py 31 63 64
gptme/tools/vision.py 19 12 53
gptme/tools/screenshot.py 14 12 44
gptme/tools/_browser_lynx.py 9 13 30
gptme/tools/youtube.py 10 1 26
gptme/tools/gh.py 14 21 16
gptme/tools/read.py 6 8 13
-------------------------------------------------------------------------------------
SUM: 1042 1086 3418
-------------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC Server#
$ make cloc-server
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/server --by-file
github.com/AlDanial/cloc v 1.98 T=0.02 s (516.9 files/s, 134071.4 lines/s)
------------------------------------------------------------------------------------------
File blank comment code
------------------------------------------------------------------------------------------
gptme/server/api_v2.py 227 155 667
gptme/server/static/main.js 35 45 316
gptme/server/api.py 65 55 263
gptme/server/server-api-improvements.md 40 0 202
gptme/server/static/index.html 11 15 148
gptme/server/static/style.css 27 4 143
gptme/server/static/computer.html 1 1 90
gptme/server/cli.py 9 5 58
gptme/server/__init__.py 2 3 3
gptme/server/__main__.py 1 0 3
------------------------------------------------------------------------------------------
SUM: 418 283 1893
------------------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC Tests#
$ make cloc-tests
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc tests --by-file
github.com/AlDanial/cloc v 1.98 T=0.04 s (968.1 files/s, 125194.7 lines/s)
--------------------------------------------------------------------------------------------
File blank comment code
--------------------------------------------------------------------------------------------
tests/test_cli.py 81 48 312
tests/test_llm_openai.py 28 0 244
tests/test_config.py 55 132 242
tests/test_llm_anthropic.py 26 0 221
tests/test_server_v2.py 62 28 193
tests/conftest.py 57 31 185
tests/test_mcp.py 33 24 143
tests/test_tool_use.py 8 18 132
tests/test_prompt.py 35 36 120
tests/test_util_cli.py 32 23 94
tests/test_tools_computer.py 36 27 91
tests/test_shell.py 27 47 82
tests/test_server.py 26 10 79
tests/test_prompt_tools.py 4 4 77
tests/test_tools.py 44 5 74
tests/test_server_v2_auto_stepping.py 16 10 73
tests/test_tools_save.py 16 10 65
tests/test_tools_tts.py 29 37 60
tests/test_context.py 18 13 58
tests/test_tools_patch.py 36 91 54
tests/test_server_v2_tool_confirmation.py 15 13 53
tests/test_eval.py 8 9 49
tests/test_server_v2_sse.py 15 13 49
tests/test-integration.sh 22 36 43
tests/test_message.py 7 17 39
tests/test_reduce.py 10 2 39
tests/test_codeblock.py 14 40 37
tests/test_util.py 28 51 37
tests/test_tools_rag.py 14 7 35
tests/test_chat.py 18 28 34
tests/test_chat_config.py 8 7 26
tests/test_tools_python.py 19 1 26
tests/test_browser.py 14 10 24
tests/test_logmanager.py 8 5 18
tests/test_prompts.py 8 2 16
tests/test_tools_chats.py 2 0 15
tests/test_tools_shell.py 9 11 13
tests/test_tools_subagent.py 7 10 11
--------------------------------------------------------------------------------------------
SUM: 895 856 3163
--------------------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC Eval#
$ make cloc-eval
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/eval/**.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.01 s (568.8 files/s, 75008.7 lines/s)
-------------------------------------------------------------------------------------
File blank comment code
-------------------------------------------------------------------------------------
gptme/eval/main.py 55 22 359
gptme/eval/run.py 48 32 279
gptme/eval/agents.py 13 5 58
gptme/eval/execenv.py 10 14 55
gptme/eval/filestore.py 5 2 32
gptme/eval/types.py 13 12 32
gptme/eval/__init__.py 1 0 4
gptme/eval/__main__.py 1 0 3
-------------------------------------------------------------------------------------
SUM: 146 87 822
-------------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC Total#
$ make cloc-total
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/wut.py gptme/commands.py gptme/cli.py gptme/prompts.py gptme/server/cli.py gptme/server/__init__.py gptme/server/__main__.py gptme/server/api.py gptme/server/api_v2.py gptme/constants.py gptme/eval/execenv.py gptme/eval/run.py gptme/eval/types.py gptme/eval/agents.py gptme/eval/main.py gptme/eval/__init__.py gptme/eval/__main__.py gptme/eval/filestore.py gptme/eval/suites/init_projects.py gptme/eval/suites/browser.py gptme/eval/suites/__init__.py gptme/eval/suites/basic.py gptme/codeblock.py gptme/__init__.py gptme/llm/llm_openai_models.py gptme/llm/__init__.py gptme/llm/llm_openai.py gptme/llm/llm_anthropic.py gptme/llm/models.py gptme/util/interrupt.py gptme/util/cli.py gptme/util/prompt.py gptme/util/export.py gptme/util/terminal.py gptme/util/__init__.py gptme/util/cost.py gptme/util/generate_name.py gptme/util/useredit.py gptme/util/reduce.py gptme/util/clipboard.py gptme/util/ask_execute.py gptme/util/context.py gptme/message.py gptme/__main__.py gptme/dirs.py gptme/ncurses.py gptme/config.py gptme/tools/browser.py gptme/tools/patch.py gptme/tools/python.py gptme/tools/screenshot.py gptme/tools/__init__.py gptme/tools/shell.py gptme/tools/tmux.py gptme/tools/youtube.py gptme/tools/computer.py gptme/tools/rag.py gptme/tools/mcp_adapter.py gptme/tools/save.py gptme/tools/_browser_playwright.py gptme/tools/vision.py gptme/tools/subagent.py gptme/tools/_browser_thread.py gptme/tools/_browser_lynx.py gptme/tools/tts.py gptme/tools/gh.py gptme/tools/base.py gptme/tools/chats.py gptme/tools/read.py gptme/init.py gptme/logmanager.py gptme/chat.py gptme/mcp/client.py gptme/mcp/__init__.py gptme/__version__.py tests/test_context.py tests/test_tools.py tests/test_llm_anthropic.py tests/test_tools_computer.py tests/test_tools_rag.py tests/test_message.py tests/test_prompt.py tests/test_shell.py tests/test_server_v2_sse.py tests/test_chat_config.py tests/test_config.py tests/test_tools_patch.py tests/conftest.py tests/test_tools_python.py tests/test_browser.py tests/test_server_v2_auto_stepping.py tests/test_codeblock.py tests/test_tools_chats.py tests/test_reduce.py tests/test_cli.py tests/test_tools_subagent.py tests/test_server_v2_tool_confirmation.py tests/test_eval.py tests/test_llm_openai.py tests/test_logmanager.py tests/test_chat.py tests/test_prompt_tools.py tests/test_tools_save.py tests/test_server.py tests/test_tools_shell.py tests/test_server_v2.py tests/test_util_cli.py tests/test_prompts.py tests/test_util.py tests/test_tools_tts.py tests/test_mcp.py tests/test_tool_use.py scripts/list_user_messages.py scripts/treeofthoughts.py scripts/convert_convo.py scripts/gpt_todoer.py scripts/summarize_project.py scripts/shorten_details.py scripts/train/collect.py scripts/reduce_context.py scripts/gh-pr-view-with-pr-comments.py scripts/check_rst_formatting.py scripts/auto_rename_logs.py scripts/describe_api.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.16 s (796.3 files/s, 149159.9 lines/s)
--------------------------------------------------------------------------------------------
File blank comment code
--------------------------------------------------------------------------------------------
gptme/server/api_v2.py 227 155 667
gptme/tools/computer.py 150 218 436
gptme/llm/llm_anthropic.py 92 74 418
gptme/llm/llm_openai.py 97 52 392
gptme/config.py 110 69 363
gptme/eval/main.py 55 22 359
gptme/tools/base.py 89 78 355
gptme/util/context.py 96 137 350
gptme/logmanager.py 75 66 328
gptme/tools/tts.py 121 136 321
gptme/tools/shell.py 74 68 317
gptme/cli.py 57 56 314
tests/test_cli.py 81 48 312
scripts/gh-pr-view-with-pr-comments.py 54 36 297
gptme/util/prompt.py 76 98 293
gptme/eval/run.py 48 32 279
gptme/chat.py 49 55 268
gptme/server/api.py 65 55 263
gptme/llm/models.py 36 17 260
tests/test_llm_openai.py 28 0 244
tests/test_config.py 55 132 242
gptme/message.py 60 65 241
gptme/prompts.py 71 90 241
gptme/commands.py 23 22 240
gptme/ncurses.py 39 5 238
gptme/llm/__init__.py 56 51 236
tests/test_llm_anthropic.py 26 0 221
gptme/tools/tmux.py 52 72 211
gptme/tools/save.py 44 43 205
gptme/util/ask_execute.py 53 46 203
gptme/tools/patch.py 44 60 195
tests/test_server_v2.py 62 28 193
gptme/tools/_browser_playwright.py 60 20 185
tests/conftest.py 57 31 185
scripts/reduce_context.py 59 72 177
gptme/util/cli.py 51 31 174
gptme/tools/python.py 56 49 172
gptme/tools/__init__.py 55 33 161
gptme/util/__init__.py 37 22 158
tests/test_mcp.py 33 24 143
gptme/tools/chats.py 43 49 142
gptme/tools/rag.py 63 75 141
gptme/llm/llm_openai_models.py 2 10 138
tests/test_tool_use.py 8 18 132
gptme/tools/mcp_adapter.py 31 23 131
tests/test_prompt.py 35 36 120
scripts/auto_rename_logs.py 34 18 115
scripts/gpt_todoer.py 47 25 107
gptme/mcp/client.py 26 9 104
gptme/tools/subagent.py 37 29 103
scripts/train/collect.py 34 52 103
gptme/tools/_browser_thread.py 20 3 97
scripts/treeofthoughts.py 33 35 97
tests/test_util_cli.py 32 23 94
tests/test_tools_computer.py 36 27 91
scripts/check_rst_formatting.py 33 37 89
gptme/util/export.py 17 25 86
tests/test_shell.py 27 47 82
scripts/convert_convo.py 33 54 81
tests/test_server.py 26 10 79
tests/test_prompt_tools.py 4 4 77
gptme/init.py 25 19 76
gptme/util/reduce.py 24 32 75
tests/test_tools.py 44 5 74
tests/test_server_v2_auto_stepping.py 16 10 73
gptme/util/generate_name.py 5 6 69
tests/test_tools_save.py 16 10 65
gptme/codeblock.py 13 10 64
gptme/tools/browser.py 31 63 64
tests/test_tools_tts.py 29 37 60
gptme/eval/agents.py 13 5 58
gptme/server/cli.py 9 5 58
tests/test_context.py 18 13 58
gptme/dirs.py 27 14 55
gptme/eval/execenv.py 10 14 55
gptme/eval/suites/basic.py 15 1 55
gptme/eval/suites/init_projects.py 21 1 55
scripts/describe_api.py 28 25 54
tests/test_tools_patch.py 36 91 54
gptme/tools/vision.py 19 12 53
tests/test_server_v2_tool_confirmation.py 15 13 53
tests/test_eval.py 8 9 49
tests/test_server_v2_sse.py 15 13 49
gptme/__version__.py 9 7 45
gptme/tools/screenshot.py 14 12 44
gptme/util/cost.py 12 20 43
tests/test_message.py 7 17 39
tests/test_reduce.py 10 2 39
tests/test_codeblock.py 14 40 37
tests/test_util.py 28 51 37
gptme/util/clipboard.py 8 2 35
tests/test_tools_rag.py 14 7 35
gptme/util/terminal.py 23 21 34
tests/test_chat.py 18 28 34
scripts/shorten_details.py 11 6 33
gptme/eval/filestore.py 5 2 32
gptme/eval/types.py 13 12 32
scripts/list_user_messages.py 10 9 32
gptme/wut.py 13 12 31
gptme/tools/_browser_lynx.py 9 13 30
gptme/tools/youtube.py 10 1 26
scripts/summarize_project.py 11 1 26
tests/test_chat_config.py 8 7 26
tests/test_tools_python.py 19 1 26
tests/test_browser.py 14 10 24
gptme/util/useredit.py 12 13 21
gptme/util/interrupt.py 13 14 20
gptme/eval/suites/__init__.py 3 0 19
tests/test_logmanager.py 8 5 18
gptme/eval/suites/browser.py 5 0 16
gptme/tools/gh.py 14 21 16
tests/test_prompts.py 8 2 16
tests/test_tools_chats.py 2 0 15
gptme/constants.py 7 11 13
gptme/tools/read.py 6 8 13
tests/test_tools_shell.py 9 11 13
tests/test_tools_subagent.py 7 10 11
gptme/__init__.py 1 0 8
gptme/eval/__init__.py 1 0 4
gptme/__main__.py 1 0 3
gptme/eval/__main__.py 1 0 3
gptme/server/__init__.py 2 3 3
gptme/server/__main__.py 1 0 3
gptme/mcp/__init__.py 1 0 2
--------------------------------------------------------------------------------------------
SUM: 4113 3764 15349
--------------------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
Code Metrics#
$ make metrics
make[2]: Entering directory '/home/runner/work/gptme/gptme'
=== Code Metrics Summary ===
Project Overview:
Files: 125
Total blocks: 923
Average complexity: 4.271939328277356
Most Complex Functions (D+):
gptme/commands.py
F 82:0 handle_cmd - E
gptme/cli.py
F 139:0 main - D
gptme/eval/main.py
F 199:0 main - D
gptme/llm/__init__.py
F 109:0 _reply_stream - D
gptme/llm/llm_anthropic.py
F 162:0 stream - D
gptme/util/ask_execute.py
F 87:0 ask_execute - D
F 206:0 execute_with_confirmation - D
gptme/util/context.py
F 498:0 _resource_to_codeblock - D
gptme/config.py
M 427:4 Config.mcp - D
gptme/tools/tmux.py
F 160:0 execute_tmux - D
gptme/tools/computer.py
F 433:0 computer - D
gptme/chat.py
F 44:0 chat - E
F 223:0 step - D
tests/test_config.py
tests/test_server_v2_auto_stepping.py
F 15:0 test_auto_stepping - D
scripts/gh-pr-view-with-pr-comments.py
M 173:4 PRViewer.get_comments - D
scripts/auto_rename_logs.py
F 31:0 auto_rename_logs - D
Largest Files (>300 SLOC):
667 gptme/server/api_v2.py
492 gptme/tools/computer.py
418 gptme/llm/llm_anthropic.py
398 gptme/llm/llm_openai.py
372 gptme/util/context.py
365 gptme/config.py
361 gptme/tools/base.py
361 gptme/eval/main.py
356 gptme/tools/shell.py
354 tests/test_config.py
331 gptme/logmanager.py
321 tests/test_cli.py
321 gptme/tools/tts.py
320 gptme/cli.py
313 gptme/util/prompt.py
Most Duplicated Files:
npm warn exec The following package was not found and will be installed: jscpd@4.0.5
Clone found (python):
- gptme/tools/tmux.py [88:8 - 100:30] (12 lines, 85 tokens)
gptme/tools/tmux.py [65:7 - 77:19]
Clone found (python):
- gptme/llm/llm_anthropic.py [166:5 - 180:5] (14 lines, 109 tokens)
gptme/llm/llm_anthropic.py [116:5 - 130:9]
Clone found (python):
- gptme/llm/llm_anthropic.py [180:7 - 193:3] (13 lines, 108 tokens)
gptme/llm/llm_anthropic.py [130:7 - 144:8]
Clone found (python):
- gptme/llm/llm_anthropic.py [274:2 - 314:8] (40 lines, 273 tokens)
gptme/llm/llm_openai.py [285:2 - 326:11]
Clone found (python):
- gptme/llm/llm_anthropic.py [353:4 - 371:88] (18 lines, 98 tokens)
gptme/llm/llm_openai.py [412:32 - 430:23]
Clone found (python):
- gptme/llm/llm_anthropic.py [469:1 - 488:2] (19 lines, 148 tokens)
gptme/llm/llm_openai.py [469:1 - 486:6]
┌────────────┬────────────────┬─────────────┬──────────────┬──────────────┬──────────────────┬───────────────────┐
│ Format │ Files analyzed │ Total lines │ Total tokens │ Clones found │ Duplicated lines │ Duplicated tokens │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ python │ 85 │ 17414 │ 119131 │ 6 │ 116 (0.67%) │ 821 (0.69%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ css │ 1 │ 173 │ 1045 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ javascript │ 1 │ 395 │ 3314 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ markup │ 2 │ 264 │ 2183 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ markdown │ 3 │ 332 │ 2373 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ bash │ 7 │ 271 │ 1263 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ url │ 1 │ 2 │ 16 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ Total: │ 100 │ 18851 │ 129325 │ 6 │ 116 (0.62%) │ 821 (0.63%) │
└────────────┴────────────────┴─────────────┴──────────────┴──────────────┴──────────────────┴───────────────────┘
Found 6 clones.
Detection time:: 1.352s
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
The metrics above show:
Project Overview: Basic stats about the codebase size and complexity
Complex Functions: Functions rated D+ (high complexity, should be refactored)
Large Files: Files over 300 SLOC (should be split into smaller modules)
Duplicated Files: Using jscpd to find duplicated code
We should aim to:
Keep average complexity below 4.0
Have no E-rated functions (extremely complex)
Have few D-rated functions (very complex)
Keep files under 300 SLOC where possible