Skip to content

Conversation

ggerganov
Copy link
Member

@ggerganov ggerganov requested a review from ngxson as a code owner January 19, 2025 16:47
@github-actions github-actions bot added examples python python script changes devops improvements to build systems and github actions server labels Jan 19, 2025
@ggerganov ggerganov force-pushed the gg/server-increase-timeout branch from 9d33e12 to 9d65a3d Compare January 19, 2025 16:50
Comment on lines 91 to 93
def start(self, timeout_seconds: int = 10) -> None:
if "LLAMA_SANITIZE" in os.environ:
timeout_seconds = 30
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe doing this to limit LLAMA_SANITIZE to only control the default value:

DEFAULT_HTTP_TIMEOUT = 10 if "LLAMA_SANITIZE" not in os.environ else 30
Suggested change
def start(self, timeout_seconds: int = 10) -> None:
if "LLAMA_SANITIZE" in os.environ:
timeout_seconds = 30
def start(self, timeout_seconds_: int | None = DEFAULT_HTTP_TIMEOUT) -> None:

@ggerganov ggerganov merged commit 92bc493 into master Jan 19, 2025
9 checks passed
@ggerganov ggerganov deleted the gg/server-increase-timeout branch January 19, 2025 18:22
anagri pushed a commit to BodhiSearch/llama.cpp that referenced this pull request Jan 26, 2025
* tests : increase timeout when sanitizers are enabled

* tests : add DEFAULT_HTTP_TIMEOUT
tinglou pushed a commit to tinglou/llama.cpp that referenced this pull request Feb 13, 2025
* tests : increase timeout when sanitizers are enabled

* tests : add DEFAULT_HTTP_TIMEOUT
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Feb 26, 2025
* tests : increase timeout when sanitizers are enabled

* tests : add DEFAULT_HTTP_TIMEOUT
mglambda pushed a commit to mglambda/llama.cpp that referenced this pull request Mar 8, 2025
* tests : increase timeout when sanitizers are enabled

* tests : add DEFAULT_HTTP_TIMEOUT
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
devops improvements to build systems and github actions examples python python script changes server
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants