[Bug]: [Java] Error stopping ChromeDriverService

[wisty]

Description

linux Error stopping ChromeDriverService
�[0;39m - 【WL-Task-4f413e15-92dd-4af8-9cfc-d311d93e2c59】Error stopping ChromeDriverService java.lang.RuntimeException: java.lang.InterruptedException at org.openqa.selenium.net.UrlChecker.waitUntilUnavailable(UrlChecker.java:153) at org.openqa.selenium.remote.service.DriverService.stop(DriverService.java:300) at org.dromara.wisdom.ma.spider.weblink.WebLinkSpiderTask.safeStop(WebLinkSpiderTask.java:473) at org.dromara.wisdom.ma.spider.weblink.WebLinkSpiderTask.checkCompletion(WebLinkSpiderTask.java:200) at org.dromara.wisdom.ma.spider.weblink.WebLinkSpiderTask.processTask(WebLinkSpiderTask.java:179) at org.dromara.wisdom.ma.spider.weblink.WebLinkSpiderTask.lambda$processSingleLink$3(WebLinkSpiderTask.java:385) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:833) Caused by: java.lang.InterruptedException: null at java.base/java.util.concurrent.FutureTask.awaitDone(FutureTask.java:418) at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:203) at org.openqa.selenium.net.UrlChecker.waitUntilUnavailable(UrlChecker.java:141) ... 8 common frames omitted

Have you considered any alternatives or workarounds?

` private void initializeDriverPool() {
for (int i = 0; i < maxThreads; i++) {
driverPool.add(createNewDriver());
}
}

private WebDriver createNewDriver() {
    ChromeOptions options = new ChromeOptions();
    options.addArguments("--headless", "--disable-gpu", "--no-sandbox", "--disable-dev-shm-usage", "--disable-blink-features=AutomationControlled", "--user-agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36");
    options.setExperimentalOption("excludeSwitches", Collections.singletonList("enable-automation"));
    Map<String, Object> prefs = new HashMap<>();
    prefs.put("profile.managed_default_content_settings.javascript", 2);  // 禁用 JS
    prefs.put("profile.managed_default_content_settings.stylesheet", 2);  // 禁用 CSS
    options.setExperimentalOption("prefs", prefs);
    WebDriver driver = new ChromeDriver(driverService, options);
    driver.manage().timeouts().pageLoadTimeout(timeoutSeconds, TimeUnit.SECONDS);
    return driver;
}`

[selenium-ci]

@wisty, thank you for creating this issue. We will troubleshoot it as soon as we can.

Selenium Triage Team: remember to follow the Triage Guide

[wisty]

    <!-- https://mvnrepository.com/artifact/org.seleniumhq.selenium/selenium-chrome-driver -->
    <dependency>
        <groupId>org.seleniumhq.selenium</groupId>
        <artifactId>selenium-chrome-driver</artifactId>
        <version>4.34.0</version>
    </dependency>

    <dependency>
        <groupId>org.seleniumhq.selenium</groupId>
        <artifactId>selenium-devtools-v138</artifactId>
        <version>4.34.0</version>
    </dependency>

[wisty]

private void safeStop() {
// 1. 移除关闭钩子（首先执行，避免在关闭过程中被钩子干扰）
if (shutdownHook != null) {
try {
Runtime.getRuntime().removeShutdownHook(shutdownHook);
} catch (IllegalStateException e) {
// JVM正在关闭，忽略
} catch (Exception e) {
log.warn("Error removing shutdown hook for task {}", taskId, e);
}
}

    // 2. 关闭线程池
    if (executor != null) {
        executor.shutdownNow();
        try {
            if (!executor.awaitTermination(15, TimeUnit.SECONDS)) {
                log.warn("Task {} threads did not terminate in time", taskId);
            }
        } catch (InterruptedException e) {
            Thread.currentThread().interrupt();
        } catch (Exception e) {
            log.warn("Error shutting down executor for task {}", taskId, e);
        }
    }

    if (driverPool != null) {
        // 清理driverPool中的引用
        driverPool.clear();
    }

    // === 新增：关闭ChromeDriver服务 ===
    if (driverService != null && driverService.isRunning()) {
        try {
            driverService.stop();
            log.info("【{}】ChromeDriverService stopped", taskId);
        } catch (Exception e) {
            log.warn("【{}】Error stopping ChromeDriverService", taskId, e);
        }
    }

    // 4. 清理资源引用
    visitedUrls = null;
    fileLinks = null;
    driverPool = null;
    executor = null;
    onTaskSafeStopCallback();
    log.info("Task {} stopped", taskId);
}

[wisty]

        // === 新增：启动ChromeDriver服务 ===
        try {
            String osName = System.getProperty("os.name").toLowerCase();
            String chromeDriverPath = "";
            if (osName.contains("win")) {
                chromeDriverPath = "E:\\chromedriver.exe";
            } else if (osName.contains("linux")) {
                chromeDriverPath = "/usr/local/bin/chromedriver";
            } else {
                throw new IllegalStateException("Unsupported OS: " + osName);
            }
            driverService = new ChromeDriverService.Builder()
                .usingDriverExecutable(new File(chromeDriverPath))
                .usingAnyFreePort()
                .build();
            driverService.start();
            log.info("【{}】ChromeDriverService started on port {}", taskId, driverService.getUrl().getPort());
        } catch (IOException e) {
            log.error("【{}】Failed to start ChromeDriverService", taskId, e);
            state = TaskState.FAILED;
            cleanupResources();
            return;
        }

[selenium-ci]

Hi, @wisty.
Please follow the issue template; we need more information to reproduce the issue.

Either a complete code snippet and URL/HTML (if more than one file is needed, provide a GitHub repo and instructions to run the code), the specific versions used, or a more detailed description to help us understand the issue.

Note: If you cannot share your code and URL/HTML, any complete code snippet and URL/HTML that reproduces the issue is good enough.

Reply to this issue when all information is provided. Thank you.

[wisty]

@cgoldberg

[cgoldberg]

@wisty since you filed this is a feature request rather than a bug, you weren't presented with the issue template where it asked you important details like your operating system and version of browser/driver and selenium.

Please provide all of that information along with a short piece of code that reproduces the issue (no more than a few lines) using the minimum amount of browser options, along with the complete error message and stack trace. Nobody is going to debug hundreds of lines of your code to figure out if this is even a selenium issue.

[wisty]

run with linux @cgoldberg

import org.openqa.selenium.WebDriver;
import org.openqa.selenium.chrome.ChromeDriver;
import org.openqa.selenium.chrome.ChromeDriverService;
import org.openqa.selenium.chrome.ChromeOptions;

import java.io.File;
import java.io.IOException;
import java.net.URI;
import java.net.URISyntaxException;
import java.util.Collections;
import java.util.HashMap;
import java.util.Map;

/**

• 最小可复现的 Selenium 示例

• 演示单线程环境下的 ChromeDriver 使用
  */
  public class MinimalSeleniumExample {

  private ChromeDriverService driverService;
  private WebDriver driver;

  public void setupDriver() throws IOException {
  // 启动 ChromeDriver 服务
  String osName = System.getProperty("os.name").toLowerCase();
  String chromeDriverPath = "";
  if (osName.contains("win")) {
  chromeDriverPath = "E:\chromedriver.exe";
  } else if (osName.contains("linux")) {
  chromeDriverPath = "/usr/local/bin/chromedriver";
  } else {
  throw new IllegalStateException("Unsupported OS: " + osName);
  }

   driverService = new ChromeDriverService.Builder()
       .usingDriverExecutable(new File(chromeDriverPath))
       .usingAnyFreePort()
       .build();
   driverService.start();
   System.out.println("ChromeDriverService started on port " + driverService.getUrl().getPort());
  

  }

  public void createDriver() {
  // 配置 ChromeOptions
  ChromeOptions options = new ChromeOptions();
  options.addArguments("--headless", "--disable-gpu", "--no-sandbox", "--disable-dev-shm-usage");
  options.setExperimentalOption("excludeSwitches", Collections.singletonList("enable-automation"));
  Map<String, Object> prefs = new HashMap<>();
  prefs.put("profile.managed_default_content_settings.javascript", 2);
  prefs.put("profile.managed_default_content_settings.stylesheet", 2);
  options.setExperimentalOption("prefs", prefs);

   // 创建 WebDriver 实例
   driver = new ChromeDriver(driverService, options);
   driver.manage().timeouts().pageLoadTimeout(java.time.Duration.ofSeconds(30));
  

  }

  public void crawlPage(String url) {
  try {
  System.out.println("Visiting URL: " + url);
  driver.get(url);
  String title = driver.getTitle();
  System.out.println("Page title: " + title);
  } catch (Exception e) {
  System.err.println("Error crawling page: " + e.getMessage());
  e.printStackTrace();
  }
  }

  public void tearDown() {
  // 关闭 WebDriver
  if (driver != null) {
  try {
  driver.quit();
  } catch (Exception e) {
  System.err.println("Error quitting driver: " + e.getMessage());
  }
  }

   // 停止 ChromeDriver 服务
   if (driverService != null && driverService.isRunning()) {
       try {
           driverService.stop();
           System.out.println("ChromeDriverService stopped");
       } catch (Exception e) {
           System.err.println("Error stopping ChromeDriverService: " + e.getMessage());
       }
   }
  

  }

  public static void main(String[] args) {
  MinimalSeleniumExample example = new MinimalSeleniumExample();

   try {
       // 设置并启动驱动
       example.setupDriver();
       example.createDriver();
       
       // 爬取页面
       example.crawlPage("https://www.example.com");
       
   } catch (Exception e) {
       e.printStackTrace();
   } finally {
       // 清理资源
       example.tearDown();
   }
  

  }
  }