Are we tiny?#
gptme is intended to be small and simple, and focus on doing the right thing in the right way, rather than all the things in all the ways.
The benefits of this approach are many:
It is easier to understand and maintain.
It is easier to contribute to.
It is easier to learn.
It is easier to extend.
It is more fun to work on.
Being aggressive about keeping things small and simple is a way to keep the project maintainable and fun to work on. The fastest way to kill a project is to make it too big and complex, and suffer burnout as a result.
Another major benefit of keeping things small and simple is that it makes it easier for AI to understand and work with the codebase. This is a major goal of the project, and it is important to keep in mind that the simpler the codebase is, the easier it will be for AI to work with it:
“The simpler your API is, the more effectively the AI can harness it when generating code.”
—Kenneth Reitz (and many others)
To that end, in this document we will present some statistics about the current state of the project, trying to be mindful to keep an eye on this page and make sure we are not growing too much.
Startup time#
$ make bench-import
make[2]: Entering directory '/home/runner/work/gptme/gptme'
Benchmarking import time for gptme
time poetry run python -X importtime -m gptme --model openai --non-interactive 2>&1 | grep "import time" | cut -d'|' -f 2- | sort -n | tail -n 10
325281 | gptme.commands
334474 | gptme.chat
349331 | mcp
349357 | mcp.types
349652 | gptme.mcp.client
350820 | gptme.mcp
350859 | gptme.mcp.client
351165 | gptme.tools.mcp_adapter
860565 | gptme.cli
912934 | gptme
real 0m1.973s
user 0m1.750s
sys 0m0.240s
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
$ make bench-startup
make[2]: Entering directory '/home/runner/work/gptme/gptme'
Benchmarking startup time for gptme
hyperfine "poetry run gptme '/exit'" -M 5 || poetry run gptme '/exit' || exit 1
Benchmark 1: poetry run gptme '/exit'
Time (mean ± σ): 1.967 s ± 0.025 s [User: 1.771 s, System: 0.192 s]
Range (min … max): 1.944 s … 2.006 s 5 runs
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
Lines of code#
LoC Core#
$ make cloc-core
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/*.py gptme/llm/*.py gptme/util/*.py gptme/tools/__init__.py gptme/tools/base.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.10 s (470.9 files/s, 139150.9 lines/s)
-----------------------------------------------------------------------------------
File blank comment code
-----------------------------------------------------------------------------------
gptme/config.py 165 140 605
gptme/llm/llm_openai.py 114 68 504
gptme/util/cli.py 142 73 498
gptme/llm/models.py 74 59 487
gptme/tools/base.py 119 120 485
gptme/setup.py 107 55 462
gptme/llm/llm_anthropic.py 96 94 441
gptme/prompts.py 116 134 400
gptme/commands.py 94 65 381
gptme/cli.py 63 54 380
gptme/logmanager.py 83 68 365
gptme/chat.py 70 76 347
gptme/util/context.py 86 124 337
gptme/util/prompt.py 77 98 296
gptme/util/gh.py 55 66 284
gptme/util/_telemetry.py 60 54 258
gptme/telemetry.py 72 40 247
gptme/llm/__init__.py 62 53 246
gptme/ncurses.py 39 5 238
gptme/message.py 50 54 227
gptme/util/_sound_sounddevice.py 52 52 208
gptme/util/ask_execute.py 53 46 203
gptme/util/sound.py 65 72 200
gptme/tools/__init__.py 61 40 196
gptme/llm/llm_openai_models.py 2 11 169
gptme/codeblock.py 32 68 147
gptme/util/__init__.py 31 22 139
gptme/util/auto_naming.py 46 41 127
gptme/llm/utils.py 38 48 103
gptme/util/tree.py 21 13 91
gptme/util/export.py 17 25 86
gptme/init.py 21 8 76
gptme/util/reduce.py 24 32 75
gptme/util/generate_name.py 5 6 69
gptme/util/_sound_cmd.py 22 17 64
gptme/util/output_storage.py 26 36 58
gptme/dirs.py 27 14 55
gptme/__version__.py 9 7 45
gptme/util/tokens.py 22 16 44
gptme/util/cost.py 12 20 43
gptme/util/clipboard.py 8 2 35
gptme/util/terminal.py 23 21 34
gptme/wut.py 13 12 31
gptme/util/content.py 12 14 24
gptme/util/useredit.py 12 13 21
gptme/util/interrupt.py 13 14 20
gptme/constants.py 9 11 15
gptme/__init__.py 1 1 8
gptme/__main__.py 1 0 3
-----------------------------------------------------------------------------------
SUM: 2422 2182 9877
-----------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC LLM#
$ make cloc-llm
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/llm/*.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.02 s (270.3 files/s, 120258.2 lines/s)
---------------------------------------------------------------------------------
File blank comment code
---------------------------------------------------------------------------------
gptme/llm/llm_openai.py 114 68 504
gptme/llm/models.py 74 59 487
gptme/llm/llm_anthropic.py 96 94 441
gptme/llm/__init__.py 62 53 246
gptme/llm/llm_openai_models.py 2 11 169
gptme/llm/utils.py 38 48 103
---------------------------------------------------------------------------------
SUM: 386 333 1950
---------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC Tools#
$ make cloc-tools
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/tools/*.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.07 s (488.0 files/s, 154942.2 lines/s)
-------------------------------------------------------------------------------------
File blank comment code
-------------------------------------------------------------------------------------
gptme/tools/shell.py 184 212 766
gptme/tools/base.py 119 120 485
gptme/tools/computer.py 150 218 436
gptme/tools/gh.py 85 93 349
gptme/tools/mcp_adapter.py 89 83 286
gptme/tools/tts.py 117 131 270
gptme/tools/_browser_playwright.py 89 32 261
gptme/tools/subagent.py 76 110 259
gptme/tools/save.py 55 53 253
gptme/tools/autocompact.py 93 96 245
gptme/tools/todo.py 85 95 211
gptme/tools/patch.py 48 62 201
gptme/tools/tmux.py 54 73 198
gptme/tools/__init__.py 61 40 196
gptme/tools/precommit.py 64 87 189
gptme/tools/mcp.py 55 44 179
gptme/tools/morph.py 43 42 178
gptme/tools/lessons.py 66 81 176
gptme/tools/python.py 56 49 172
gptme/tools/chats.py 43 49 142
gptme/tools/rag.py 63 75 141
gptme/tools/token_awareness.py 47 64 137
gptme/tools/_browser_thread.py 23 4 117
gptme/tools/complete.py 34 41 104
gptme/tools/choice.py 30 25 103
gptme/tools/time_awareness.py 32 37 85
gptme/tools/browser.py 40 87 84
gptme/tools/_browser_perplexity.py 24 22 81
gptme/tools/autocommit.py 37 59 75
gptme/tools/vision.py 19 12 53
gptme/tools/screenshot.py 14 12 44
gptme/tools/_browser_lynx.py 9 13 30
gptme/tools/youtube.py 10 1 26
gptme/tools/read.py 6 8 13
-------------------------------------------------------------------------------------
SUM: 2020 2230 6545
-------------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC Server#
$ make cloc-server
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/server --by-file
github.com/AlDanial/cloc v 1.98 T=0.04 s (461.4 files/s, 150892.0 lines/s)
------------------------------------------------------------------------------------------
File blank comment code
------------------------------------------------------------------------------------------
gptme/server/api_v2_sessions.py 148 125 607
gptme/server/tasks_api.py 171 110 580
gptme/server/openapi_docs.py 177 140 455
gptme/server/api.py 86 80 348
gptme/server/static/main.js 35 45 316
gptme/server/api_v2.py 69 45 313
gptme/server/server-api-improvements.md 40 0 202
gptme/server/workspace_api.py 57 55 170
gptme/server/api_v2_agents.py 38 28 149
gptme/server/static/index.html 11 15 148
gptme/server/static/style.css 27 4 143
gptme/server/auth.py 45 69 121
gptme/server/cli.py 23 10 109
gptme/server/static/computer.html 1 1 90
gptme/server/api_v2_common.py 48 24 69
gptme/server/__init__.py 2 3 3
gptme/server/__main__.py 1 0 3
------------------------------------------------------------------------------------------
SUM: 979 754 3826
------------------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC Tests#
$ make cloc-tests
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc tests --by-file
github.com/AlDanial/cloc v 1.98 T=0.11 s (714.0 files/s, 151039.9 lines/s)
--------------------------------------------------------------------------------------------
File blank comment code
--------------------------------------------------------------------------------------------
tests/test_tools_shell.py 162 306 464
tests/test_config.py 109 212 413
tests/test_util_gh_mocked.py 63 47 405
tests/test_util_cli_mcp.py 89 45 380
tests/test_mcp_discovery.py 128 37 351
tests/test_llm_openai.py 76 38 334
tests/test_codeblock.py 214 492 331
tests/test_cli.py 82 55 296
tests/test_lessons_commands.py 98 44 255
tests/test_lessons_integration.py 91 59 239
tests/test_server_v2.py 69 33 228
tests/test_llm_anthropic.py 26 0 221
tests/test_lessons_parser.py 89 82 201
tests/test_server_v2_hooks.py 82 75 198
tests/test_lessons_tool.py 55 26 194
tests/conftest.py 62 37 193
tests/test_mcp_adapter.py 65 37 191
tests/test_hooks.py 90 24 184
tests/test_lessons_matcher.py 46 21 166
tests/test_mcp.py 41 31 162
tests/test_tools_subagent.py 68 35 161
tests/test_tools_time_awareness.py 52 34 158
tests/test_context.py 68 42 149
tests/test_tree.py 54 29 142
tests/test_dspy_integration.py 54 32 139
tests/test_auto_compact.py 69 52 138
tests/test_tool_use.py 11 19 137
tests/test_dspy_basic.py 49 31 132
tests/test_tools_token_awareness.py 59 47 127
tests/test_prompt.py 36 36 120
tests/test_complete.py 29 19 117
tests/test_tools_todo.py 53 46 117
tests/test_lessons_status.py 67 96 113
tests/test_auto_naming.py 37 23 106
tests/test_util_cli.py 35 28 105
tests/test_tools_tts.py 50 58 101
tests/test_tools_patch.py 60 141 96
tests/test_tools_computer.py 36 27 91
tests/test_util_gh.py 39 28 91
tests/test_server_v2_auto_stepping.py 20 21 87
tests/test_server.py 27 10 85
tests/test_server_auth.py 40 19 84
tests/test_prompt_tools.py 5 4 77
tests/test_tools.py 45 6 76
tests/test_llm_models.py 27 14 75
tests/test_markdown_validation.py 43 34 75
tests/test_shell_issue729.py 50 52 75
tests/test_shell_issue772.py 48 47 73
tests/test_tools_save.py 15 10 65
tests/test_server_v2_tool_confirmation.py 20 20 60
tests/test_custom_providers.py 23 32 49
tests/test_eval.py 9 9 49
tests/test_server_v2_sse.py 15 13 49
tests/test_chat_history.py 17 10 45
tests/test-integration.sh 22 36 43
tests/test_browser.py 20 15 43
tests/test_message.py 10 17 39
tests/test_reduce.py 11 2 39
tests/test_dspy_gepa.py 18 9 38
tests/test_util.py 28 51 37
tests/test_tools_rag.py 15 7 35
tests/test_hybrid_lessons.py 14 8 33
tests/test_shell_for_loop_issue724.py 16 24 33
tests/test_chat.py 16 28 28
tests/test_telemetry.py 20 15 28
tests/test_xml_format.py 10 31 27
tests/test_chat_config.py 8 7 26
tests/test_tools_python.py 19 1 26
tests/data/example-patch-codeblock.txt 4 0 25
tests/data/example-interrupted.txt 8 0 24
tests/test_tool_loading_duplicate.py 16 15 24
tests/test_prompts.py 14 7 21
tests/test_tools_shell_multiline.py 7 19 19
tests/test_logmanager.py 8 5 18
tests/test_tools_chats.py 2 0 15
--------------------------------------------------------------------------------------------
SUM: 3353 3122 9391
--------------------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC Eval#
$ make cloc-eval
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/eval/**.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.02 s (498.0 files/s, 87281.5 lines/s)
-------------------------------------------------------------------------------------
File blank comment code
-------------------------------------------------------------------------------------
gptme/eval/main.py 68 40 429
gptme/eval/run.py 50 37 313
gptme/eval/execenv.py 27 33 189
gptme/eval/agents.py 16 6 83
gptme/eval/types.py 14 12 37
gptme/eval/filestore.py 5 2 32
gptme/eval/__init__.py 1 0 4
gptme/eval/__main__.py 1 0 3
-------------------------------------------------------------------------------------
SUM: 182 130 1090
-------------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
LoC Total#
$ make cloc-total
make[2]: Entering directory '/home/runner/work/gptme/gptme'
cloc gptme/eval/types.py gptme/eval/suites/basic.py gptme/eval/suites/browser.py gptme/eval/suites/__init__.py gptme/eval/suites/init_projects.py gptme/eval/execenv.py gptme/eval/main.py gptme/eval/filestore.py gptme/eval/agents.py gptme/eval/dspy/metrics.py gptme/eval/dspy/prompt_optimizer.py gptme/eval/dspy/signatures.py gptme/eval/dspy/cli.py gptme/eval/dspy/tasks.py gptme/eval/dspy/experiments.py gptme/eval/dspy/reasoning_program.py gptme/eval/dspy/__main__.py gptme/eval/dspy/__init__.py gptme/eval/__main__.py gptme/eval/__init__.py gptme/eval/run.py gptme/mcp/client.py gptme/mcp/registry.py gptme/mcp/__init__.py gptme/setup.py gptme/llm/utils.py gptme/llm/llm_openai.py gptme/llm/llm_anthropic.py gptme/llm/llm_openai_models.py gptme/llm/__init__.py gptme/llm/models.py gptme/commands.py gptme/wut.py gptme/init.py gptme/server/api_v2_sessions.py gptme/server/auth.py gptme/server/workspace_api.py gptme/server/openapi_docs.py gptme/server/cli.py gptme/server/tasks_api.py gptme/server/api_v2_common.py gptme/server/api_v2_agents.py gptme/server/api_v2.py gptme/server/api.py gptme/server/__main__.py gptme/server/__init__.py gptme/ncurses.py gptme/cli.py gptme/constants.py gptme/chat.py gptme/codeblock.py gptme/prompts.py gptme/lessons/commands.py gptme/lessons/matcher.py gptme/lessons/auto_include.py gptme/lessons/hybrid_matcher.py gptme/lessons/parser.py gptme/lessons/__init__.py gptme/lessons/index.py gptme/tools/subagent.py gptme/tools/save.py gptme/tools/_browser_playwright.py gptme/tools/patch.py gptme/tools/_browser_thread.py gptme/tools/todo.py gptme/tools/autocompact.py gptme/tools/_browser_perplexity.py gptme/tools/time_awareness.py gptme/tools/tts.py gptme/tools/youtube.py gptme/tools/morph.py gptme/tools/tmux.py gptme/tools/chats.py gptme/tools/rag.py gptme/tools/python.py gptme/tools/computer.py gptme/tools/mcp_adapter.py gptme/tools/token_awareness.py gptme/tools/complete.py gptme/tools/choice.py gptme/tools/gh.py gptme/tools/autocommit.py gptme/tools/mcp.py gptme/tools/vision.py gptme/tools/shell.py gptme/tools/browser.py gptme/tools/read.py gptme/tools/_browser_lynx.py gptme/tools/__init__.py gptme/tools/lessons.py gptme/tools/precommit.py gptme/tools/screenshot.py gptme/tools/base.py gptme/hooks/markdown_validation.py gptme/hooks/__init__.py gptme/__version__.py gptme/message.py gptme/telemetry.py gptme/__main__.py gptme/logmanager.py gptme/config.py gptme/dirs.py gptme/__init__.py gptme/util/context.py gptme/util/terminal.py gptme/util/interrupt.py gptme/util/cost.py gptme/util/export.py gptme/util/ask_execute.py gptme/util/output_storage.py gptme/util/_telemetry.py gptme/util/cli.py gptme/util/generate_name.py gptme/util/useredit.py gptme/util/reduce.py gptme/util/tokens.py gptme/util/_sound_cmd.py gptme/util/prompt.py gptme/util/auto_naming.py gptme/util/tree.py gptme/util/sound.py gptme/util/clipboard.py gptme/util/gh.py gptme/util/_sound_sounddevice.py gptme/util/content.py gptme/util/__init__.py tests/test_tools_rag.py tests/test_shell_issue729.py tests/test_tools.py tests/test_tool_loading_duplicate.py tests/test_dspy_gepa.py tests/test_shell_issue772.py tests/test_eval.py tests/test_llm_models.py tests/test_cli.py tests/test_lessons_tool.py tests/test_xml_format.py tests/test_auto_compact.py tests/test_tool_use.py tests/test_complete.py tests/test_server_v2_tool_confirmation.py tests/test_llm_anthropic.py tests/test_shell_for_loop_issue724.py tests/test_util_gh_mocked.py tests/test_lessons_status.py tests/test_mcp_adapter.py tests/test_util_cli_mcp.py tests/test_chat_config.py tests/test_tools_computer.py tests/test_prompt.py tests/test_server_v2_auto_stepping.py tests/test_server_v2_sse.py tests/test_server.py tests/test_telemetry.py tests/test_server_auth.py tests/test_markdown_validation.py tests/test_util_cli.py tests/test_lessons_commands.py tests/test_auto_naming.py tests/test_codeblock.py tests/test_mcp_discovery.py tests/test_browser.py tests/test_logmanager.py tests/test_tools_token_awareness.py tests/test_util_gh.py tests/test_tools_chats.py tests/test_config.py tests/test_lessons_integration.py tests/test_tools_shell_multiline.py tests/test_lessons_parser.py tests/test_prompts.py tests/test_reduce.py tests/test_tools_shell.py tests/test_llm_openai.py tests/test_lessons_matcher.py tests/test_tools_save.py tests/test_tools_tts.py tests/test_tools_subagent.py tests/test_tools_python.py tests/test_hybrid_lessons.py tests/test_dspy_integration.py tests/test_server_v2_hooks.py tests/test_hooks.py tests/test_context.py tests/test_tools_todo.py tests/test_tree.py tests/test_mcp.py tests/test_server_v2.py tests/conftest.py tests/test_message.py tests/test_chat.py tests/test_custom_providers.py tests/test_prompt_tools.py tests/test_tools_time_awareness.py tests/test_util.py tests/test_dspy_basic.py tests/test_chat_history.py tests/test_tools_patch.py scripts/convert_convo.py scripts/auto_rename_logs.py scripts/list_user_messages.py scripts/check_rst_formatting.py scripts/gh-pr-view-with-pr-comments.py scripts/train/collect.py scripts/treeofthoughts.py scripts/gpt_todoer.py scripts/summarize_project.py scripts/reduce_context.py scripts/describe_api.py scripts/shorten_details.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.34 s (623.2 files/s, 160234.4 lines/s)
--------------------------------------------------------------------------------------------
File blank comment code
--------------------------------------------------------------------------------------------
gptme/tools/shell.py 184 212 766
gptme/server/api_v2_sessions.py 148 125 607
gptme/config.py 165 140 605
gptme/eval/dspy/tasks.py 152 312 605
gptme/server/tasks_api.py 171 110 580
gptme/llm/llm_openai.py 114 68 504
gptme/util/cli.py 142 73 498
gptme/llm/models.py 74 59 487
gptme/tools/base.py 119 120 485
tests/test_tools_shell.py 162 306 464
gptme/setup.py 107 55 462
gptme/server/openapi_docs.py 177 140 455
gptme/llm/llm_anthropic.py 96 94 441
gptme/tools/computer.py 150 218 436
gptme/eval/main.py 68 40 429
tests/test_config.py 109 212 413
tests/test_util_gh_mocked.py 63 47 405
gptme/prompts.py 116 134 400
gptme/eval/dspy/prompt_optimizer.py 99 64 394
gptme/commands.py 94 65 381
gptme/cli.py 63 54 380
tests/test_util_cli_mcp.py 89 45 380
gptme/logmanager.py 83 68 365
gptme/eval/dspy/experiments.py 94 60 351
tests/test_mcp_discovery.py 128 37 351
gptme/tools/gh.py 85 93 349
gptme/server/api.py 86 80 348
gptme/chat.py 70 76 347
gptme/eval/dspy/metrics.py 98 98 344
gptme/eval/dspy/cli.py 71 57 341
gptme/hooks/__init__.py 120 105 339
gptme/util/context.py 86 124 337
tests/test_llm_openai.py 76 38 334
tests/test_codeblock.py 214 492 331
gptme/eval/run.py 50 37 313
gptme/server/api_v2.py 69 45 313
scripts/gh-pr-view-with-pr-comments.py 55 36 298
gptme/util/prompt.py 77 98 296
tests/test_cli.py 82 55 296
gptme/tools/mcp_adapter.py 89 83 286
gptme/util/gh.py 55 66 284
gptme/tools/tts.py 117 131 270
gptme/tools/_browser_playwright.py 89 32 261
gptme/tools/subagent.py 76 110 259
gptme/util/_telemetry.py 60 54 258
tests/test_lessons_commands.py 98 44 255
gptme/tools/save.py 55 53 253
gptme/telemetry.py 72 40 247
gptme/llm/__init__.py 62 53 246
gptme/tools/autocompact.py 93 96 245
tests/test_lessons_integration.py 91 59 239
gptme/ncurses.py 39 5 238
tests/test_server_v2.py 69 33 228
gptme/message.py 50 54 227
tests/test_llm_anthropic.py 26 0 221
gptme/mcp/registry.py 59 70 216
gptme/tools/todo.py 85 95 211
gptme/util/_sound_sounddevice.py 52 52 208
gptme/util/ask_execute.py 53 46 203
gptme/tools/patch.py 48 62 201
tests/test_lessons_parser.py 89 82 201
gptme/util/sound.py 65 72 200
gptme/tools/tmux.py 54 73 198
tests/test_server_v2_hooks.py 82 75 198
gptme/tools/__init__.py 61 40 196
tests/test_lessons_tool.py 55 26 194
tests/conftest.py 62 37 193
tests/test_mcp_adapter.py 65 37 191
gptme/eval/dspy/reasoning_program.py 57 73 190
gptme/eval/execenv.py 27 33 189
gptme/tools/precommit.py 64 87 189
tests/test_hooks.py 90 24 184
gptme/tools/mcp.py 55 44 179
gptme/tools/morph.py 43 42 178
scripts/reduce_context.py 59 72 177
gptme/tools/lessons.py 66 81 176
gptme/tools/python.py 56 49 172
gptme/server/workspace_api.py 57 55 170
gptme/llm/llm_openai_models.py 2 11 169
tests/test_lessons_matcher.py 46 21 166
tests/test_mcp.py 41 31 162
tests/test_tools_subagent.py 68 35 161
tests/test_tools_time_awareness.py 52 34 158
gptme/mcp/client.py 34 12 156
gptme/server/api_v2_agents.py 38 28 149
tests/test_context.py 68 42 149
gptme/codeblock.py 32 68 147
scripts/check_rst_formatting.py 41 52 147
gptme/tools/chats.py 43 49 142
tests/test_tree.py 54 29 142
gptme/tools/rag.py 63 75 141
gptme/util/__init__.py 31 22 139
tests/test_dspy_integration.py 54 32 139
tests/test_auto_compact.py 69 52 138
gptme/tools/token_awareness.py 47 64 137
tests/test_tool_use.py 11 19 137
gptme/lessons/hybrid_matcher.py 52 76 132
tests/test_dspy_basic.py 49 31 132
gptme/util/auto_naming.py 46 41 127
tests/test_tools_token_awareness.py 59 47 127
gptme/server/auth.py 45 69 121
tests/test_prompt.py 36 36 120
gptme/tools/_browser_thread.py 23 4 117
tests/test_complete.py 29 19 117
tests/test_tools_todo.py 53 46 117
gptme/lessons/commands.py 49 23 115
scripts/auto_rename_logs.py 34 23 115
tests/test_lessons_status.py 67 96 113
gptme/server/cli.py 23 10 109
scripts/gpt_todoer.py 47 25 107
scripts/train/collect.py 35 52 107
tests/test_auto_naming.py 37 23 106
tests/test_util_cli.py 35 28 105
gptme/tools/complete.py 34 41 104
gptme/llm/utils.py 38 48 103
gptme/tools/choice.py 30 25 103
tests/test_tools_tts.py 50 58 101
tests/test_tools_patch.py 60 141 96
scripts/treeofthoughts.py 34 35 95
gptme/lessons/index.py 40 47 92
gptme/util/tree.py 21 13 91
tests/test_tools_computer.py 36 27 91
tests/test_util_gh.py 39 28 91
tests/test_server_v2_auto_stepping.py 20 21 87
gptme/util/export.py 17 25 86
gptme/tools/time_awareness.py 32 37 85
tests/test_server.py 27 10 85
gptme/tools/browser.py 40 87 84
tests/test_server_auth.py 40 19 84
gptme/eval/agents.py 16 6 83
scripts/convert_convo.py 34 54 82
gptme/tools/_browser_perplexity.py 24 22 81
gptme/lessons/auto_include.py 31 26 79
tests/test_prompt_tools.py 5 4 77
gptme/init.py 21 8 76
tests/test_tools.py 45 6 76
gptme/tools/autocommit.py 37 59 75
gptme/util/reduce.py 24 32 75
tests/test_llm_models.py 27 14 75
tests/test_markdown_validation.py 43 34 75
tests/test_shell_issue729.py 50 52 75
gptme/lessons/parser.py 30 27 73
tests/test_shell_issue772.py 48 47 73
gptme/eval/suites/basic.py 17 0 69
gptme/server/api_v2_common.py 48 24 69
gptme/util/generate_name.py 5 6 69
tests/test_tools_save.py 15 10 65
gptme/util/_sound_cmd.py 22 17 64
gptme/eval/suites/init_projects.py 21 1 62
tests/test_server_v2_tool_confirmation.py 20 20 60
gptme/util/output_storage.py 26 36 58
gptme/eval/dspy/signatures.py 19 21 56
gptme/dirs.py 27 14 55
scripts/describe_api.py 28 25 54
gptme/tools/vision.py 19 12 53
gptme/hooks/markdown_validation.py 36 41 51
gptme/lessons/matcher.py 26 24 51
tests/test_custom_providers.py 23 32 49
tests/test_eval.py 9 9 49
tests/test_server_v2_sse.py 15 13 49
gptme/__version__.py 9 7 45
tests/test_chat_history.py 17 10 45
gptme/tools/screenshot.py 14 12 44
gptme/util/tokens.py 22 16 44
gptme/util/cost.py 12 20 43
tests/test_browser.py 20 15 43
tests/test_message.py 10 17 39
tests/test_reduce.py 11 2 39
tests/test_dspy_gepa.py 18 9 38
gptme/eval/types.py 14 12 37
tests/test_util.py 28 51 37
gptme/util/clipboard.py 8 2 35
tests/test_tools_rag.py 15 7 35
gptme/util/terminal.py 23 21 34
scripts/shorten_details.py 11 6 33
tests/test_hybrid_lessons.py 14 8 33
tests/test_shell_for_loop_issue724.py 16 24 33
gptme/eval/filestore.py 5 2 32
scripts/list_user_messages.py 10 9 32
gptme/wut.py 13 12 31
gptme/tools/_browser_lynx.py 9 13 30
tests/test_chat.py 16 28 28
tests/test_telemetry.py 20 15 28
tests/test_xml_format.py 10 31 27
gptme/tools/youtube.py 10 1 26
scripts/summarize_project.py 12 1 26
tests/test_chat_config.py 8 7 26
tests/test_tools_python.py 19 1 26
gptme/util/content.py 12 14 24
tests/test_tool_loading_duplicate.py 16 15 24
gptme/util/useredit.py 12 13 21
tests/test_prompts.py 14 7 21
gptme/util/interrupt.py 13 14 20
gptme/eval/suites/__init__.py 3 0 19
tests/test_tools_shell_multiline.py 7 19 19
tests/test_logmanager.py 8 5 18
gptme/eval/suites/browser.py 5 0 17
gptme/lessons/__init__.py 7 15 16
gptme/constants.py 9 11 15
tests/test_tools_chats.py 2 0 15
gptme/mcp/__init__.py 1 0 14
gptme/tools/read.py 6 8 13
gptme/__init__.py 1 1 8
gptme/eval/dspy/__init__.py 6 6 7
gptme/eval/__init__.py 1 0 4
gptme/__main__.py 1 0 3
gptme/eval/__main__.py 1 0 3
gptme/eval/dspy/__main__.py 3 5 3
gptme/server/__init__.py 2 3 3
gptme/server/__main__.py 1 0 3
--------------------------------------------------------------------------------------------
SUM: 10158 9710 34122
--------------------------------------------------------------------------------------------
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
Code Metrics#
$ make metrics
make[2]: Entering directory '/home/runner/work/gptme/gptme'
=== Code Metrics Summary ===
Project Overview:
Files: 214
Total blocks: 2000
Average complexity: 4.4255
Most Complex Functions (D+):
gptme/eval/main.py
F 285:0 main - D
gptme/llm/llm_openai.py
F 66:0 init - D
F 300:0 stream - D
gptme/llm/llm_anthropic.py
F 523:0 _prepare_messages_for_api - D
F 266:0 stream - D
gptme/llm/__init__.py
F 128:0 _reply_stream - D
gptme/server/api_v2_sessions.py
F 219:0 step - E
gptme/server/openapi_docs.py
F 522:0 _convert_to_openapi_nullable - D
gptme/server/tasks_api.py
F 357:0 get_git_status - D
gptme/server/api_v2_agents.py
F 59:0 api_agents_put - D
gptme/cli.py
gptme/codeblock.py
F 70:0 _extract_codeblocks - E
gptme/prompts.py
F 503:0 prompt_chat_history - E
F 355:0 prompt_workspace - D
gptme/tools/tmux.py
F 150:0 execute_tmux - D
gptme/tools/computer.py
F 433:0 computer - D
gptme/tools/token_awareness.py
F 83:0 add_token_usage_warning - D
gptme/tools/gh.py
F 57:0 _wait_for_checks - D
gptme/tools/shell.py
M 270:4 ShellSession._run - E
F 947:0 _shorten_stdout - D
gptme/tools/lessons.py
F 151:0 auto_include_lessons_hook - D
gptme/telemetry.py
F 230:0 record_llm_request - D
gptme/config.py
F 784:0 setup_config_from_cli - E
M 656:4 Config.mcp - D
gptme/util/context.py
F 443:0 _resource_to_codeblock - D
gptme/util/ask_execute.py
F 87:0 ask_execute - D
F 206:0 execute_with_confirmation - D
gptme/util/gh.py
tests/test_server_v2_auto_stepping.py
F 16:0 test_auto_stepping - E
tests/test_config.py
F 532:0 test_project_config_loaded_from_toml - D
F 560:0 test_project_config_loaded_from_json - D
scripts/auto_rename_logs.py
F 32:0 auto_rename_logs - D
scripts/check_rst_formatting.py
F 26:0 check_file - E
scripts/gh-pr-view-with-pr-comments.py
M 175:4 PRViewer.get_comments - D
Largest Files (>300 SLOC):
854 gptme/eval/dspy/tasks.py
809 gptme/tools/shell.py
647 tests/test_tools_shell.py
613 tests/test_codeblock.py
607 gptme/server/api_v2_sessions.py
607 gptme/config.py
589 tests/test_config.py
580 gptme/server/tasks_api.py
505 gptme/llm/llm_openai.py
500 gptme/util/cli.py
498 gptme/llm/models.py
492 gptme/tools/computer.py
491 gptme/tools/base.py
479 gptme/server/openapi_docs.py
471 gptme/setup.py
448 gptme/prompts.py
443 gptme/llm/llm_anthropic.py
432 gptme/eval/main.py
410 gptme/tools/gh.py
405 tests/test_util_gh_mocked.py
395 gptme/eval/dspy/prompt_optimizer.py
386 gptme/cli.py
384 gptme/commands.py
380 tests/test_util_cli_mcp.py
368 gptme/logmanager.py
359 gptme/util/context.py
356 gptme/eval/dspy/experiments.py
351 tests/test_mcp_discovery.py
349 gptme/server/api.py
349 gptme/eval/dspy/metrics.py
347 gptme/chat.py
341 gptme/eval/dspy/cli.py
339 gptme/hooks/__init__.py
336 tests/test_llm_openai.py
316 gptme/util/prompt.py
314 gptme/eval/run.py
313 gptme/server/api_v2.py
305 tests/test_cli.py
301 gptme/util/gh.py
make[3]: Entering directory '/home/runner/work/gptme/gptme'
Most Duplicated Files:
npm warn exec The following package was not found and will be installed: jscpd@4.0.5
Clone found (python):
- gptme/util/_sound_sounddevice.py [95:5 - 106:67] (11 lines, 101 tokens)
gptme/util/_sound_sounddevice.py [55:5 - 66:27]
Clone found (python):
- gptme/tools/subagent.py [283:2 - 313:64] (30 lines, 181 tokens)
gptme/tools/subagent.py [133:7 - 163:42]
Clone found (python):
- gptme/tools/gh.py [368:9 - 379:30] (11 lines, 92 tokens)
gptme/tools/gh.py [229:9 - 240:12]
Clone found (python):
- gptme/server/api.py [176:5 - 186:43] (10 lines, 83 tokens)
gptme/server/api_v2.py [161:5 - 171:4]
Clone found (python):
- gptme/server/api.py [187:5 - 193:2] (6 lines, 90 tokens)
gptme/server/api_v2.py [171:5 - 177:2]
Clone found (python):
- gptme/mcp/client.py [125:13 - 132:3] (7 lines, 75 tokens)
gptme/mcp/client.py [91:13 - 96:21]
Clone found (python):
- gptme/llm/llm_openai.py [303:5 - 319:15] (16 lines, 119 tokens)
gptme/llm/llm_openai.py [223:5 - 238:5]
Clone found (python):
- gptme/llm/llm_anthropic.py [284:7 - 297:2] (13 lines, 110 tokens)
gptme/llm/llm_anthropic.py [231:7 - 244:69]
Clone found (python):
- gptme/eval/dspy/cli.py [294:31 - 309:49] (15 lines, 104 tokens)
gptme/eval/dspy/cli.py [78:1 - 93:7]
Clone found (python):
- gptme/eval/dspy/cli.py [401:12 - 417:46] (16 lines, 93 tokens)
gptme/eval/dspy/cli.py [144:9 - 160:41]
Clone found (python):
- gptme/eval/dspy/cli.py [428:13 - 434:15] (6 lines, 84 tokens)
gptme/eval/dspy/cli.py [171:13 - 176:17]
Clone found (python):
- gptme/eval/execenv.py [167:9 - 189:50] (22 lines, 229 tokens)
gptme/eval/execenv.py [58:8 - 79:6]
Clone found (python):
- gptme/eval/execenv.py [208:2 - 218:64] (10 lines, 114 tokens)
gptme/eval/filestore.py [18:2 - 28:6]
Clone found (python):
- scripts/generate_sounds.py [165:2 - 173:13] (8 lines, 81 tokens)
scripts/generate_sounds.py [91:2 - 99:11]
Clone found (python):
- gptme/telemetry.py [36:1 - 56:4] (20 lines, 102 tokens)
gptme/util/_telemetry.py [111:1 - 131:7]
Clone found (python):
- gptme/telemetry.py [323:5 - 334:11] (11 lines, 90 tokens)
gptme/telemetry.py [86:9 - 97:10]
┌────────────┬────────────────┬─────────────┬──────────────┬──────────────┬──────────────────┬───────────────────┐
│ Format │ Files analyzed │ Total lines │ Total tokens │ Clones found │ Duplicated lines │ Duplicated tokens │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ python │ 139 │ 37216 │ 248721 │ 16 │ 212 (0.57%) │ 1748 (0.7%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ css │ 1 │ 173 │ 1045 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ javascript │ 1 │ 395 │ 3314 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ markup │ 2 │ 264 │ 2183 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ markdown │ 5 │ 1020 │ 6636 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ bash │ 9 │ 335 │ 1587 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ url │ 1 │ 2 │ 16 │ 0 │ 0 (0%) │ 0 (0%) │
├────────────┼────────────────┼─────────────┼──────────────┼──────────────┼──────────────────┼───────────────────┤
│ Total: │ 158 │ 39405 │ 263502 │ 16 │ 212 (0.54%) │ 1748 (0.66%) │
└────────────┴────────────────┴─────────────┴──────────────┴──────────────┴──────────────────┴───────────────────┘
Found 16 clones.
Detection time:: 2.734s
make[3]: Leaving directory '/home/runner/work/gptme/gptme'
make[2]: Leaving directory '/home/runner/work/gptme/gptme'
The metrics above show:
Project Overview: Basic stats about the codebase size and complexity
Complex Functions: Functions rated D+ (high complexity, should be refactored)
Large Files: Files over 300 SLOC (should be split into smaller modules)
Duplicated Files: Using jscpd to find duplicated code
We should aim to:
Keep average complexity below 4.0
Have no E-rated functions (extremely complex)
Have few D-rated functions (very complex)
Keep files under 300 SLOC where possible