Android服务中的OpenCV图像处理答案

【问题标题】：OpenCV image processing in Android serviceAndroid服务中的OpenCV图像处理
【发布时间】：2024-04-21 12:35:01
【问题描述】：

我的 android 应用在带有JavaCameraView 的活动中使用 opencv for android 进行图像处理。这很好用。现在我想在后台进行相同的图像处理，而不为用户提供任何预览。我从一个 android 服务开始。

使用此代码，我可以在服务中成功加载 OpenCV：

import org.opencv.android.BaseLoaderCallback;
import org.opencv.android.LoaderCallbackInterface;
import org.opencv.android.OpenCVLoader;

import android.app.Service;
import android.content.Intent;
import android.os.IBinder;
import android.util.Log;

public class CameraService extends Service {

private static final String TAG = "CameraService";

BaseLoaderCallback mLoaderCallback = new BaseLoaderCallback(CameraService.this) {

@Override
public void onManagerConnected(int status) {
        switch (status) {
        case LoaderCallbackInterface.SUCCESS: {
            Log.i("", "OpenCV loaded successfully");
        }
            break;
        default: {
            super.onManagerConnected(status);
        }
            break;
        }
    }
};

@Override
public int onStartCommand(Intent intent, int flags, int startId) {
    if(OpenCVLoader.initAsync(OpenCVLoader.OPENCV_VERSION_2_4_4,
                getApplicationContext(), mLoaderCallback)) {
        Log.i(TAG, "Loaded OpenCV");
    }
    else
        Log.i(TAG, "Couldn't load OpenCV");
    return super.onStartCommand(intent, flags, startId);
}

@Override
public IBinder onBind(Intent intent) {
    return null;
}

}

但我不知道如何像以前的活动onCameraFrame() 那样抓取帧？我已经实现了CvCameraViewListener2，但不在我的服务中，因为它需要CameraBridgeViewBase，我不想再显示了。如何在这样的背景下进行图像处理？

更新 -> 2

我添加了一个 runnable 来抓取帧，就像你告诉我的那样。现在加载 OpenCV 并连接到相机工作正常。但在抓取任何帧之前，他会跳过帧并中止，因为应用程序在主线程上做了太多工作。

这就是我现在的全部相机服务：

public final class MyService extends Service {

private static final String TAG = MyService.class.getSimpleName();
private boolean mStopThread;
private Thread mThread;
private VideoCapture mCamera;
private int mCameraIndex = -1;

BaseLoaderCallback mLoaderCallback = new BaseLoaderCallback(this) {
    @Override
    public void onManagerConnected(int status) {
        switch (status) {
        case LoaderCallbackInterface.SUCCESS: {
            Log.i("", "OpenCV loaded successfully");

            try {
                if (!connectCamera(640, 480))
                    Log.e(TAG, "Could not connect camera");
                else
                    Log.d(TAG, "Camera successfully connected");
            } catch (Exception e) {
                Log.e(TAG, "MyServer.connectCamera throws an exception: " + e.getMessage());
            }

        }
            break;
        default: {
            super.onManagerConnected(status);
        }
            break;
        }
    }
};

@Override
public int onStartCommand(Intent intent, int flags, int startId) {
    if(OpenCVLoader.initAsync(OpenCVLoader.OPENCV_VERSION_2_4_4, getApplicationContext(), mLoaderCallback))
        Log.i(TAG, "Loaded OpenCV");
    else
        Log.i(TAG, "Couldn't load OpenCV");
    return super.onStartCommand(intent, flags, startId);
}

public void onDestroy() {
    this.disconnectCamera();
    Log.d(TAG, "onDestroy");
    super.onDestroy();
}

private boolean connectCamera(int width, int height) {
    /* First step - initialize camera connection */
    if (!initializeCamera(width, height)) {
        Log.d(TAG, "initializeCamera failed");
        return false;
    } else {
        Log.d(TAG, "initializeCamera successfully");
    /* start update thread */
    mThread = new Thread(new CameraWorker());
    mThread.start();

    return true;
    }
}

private boolean initializeCamera(int width, int height) {
    synchronized (this) {
        if (mCameraIndex == -1)
            mCamera = new VideoCapture(Highgui.CV_CAP_ANDROID);
        else
            mCamera = new VideoCapture(Highgui.CV_CAP_ANDROID + mCameraIndex);

        if (mCamera == null)
            return false;

        if (mCamera.isOpened() == false)
            return false;

        /* Select the size that fits surface considering maximum size allowed */
        Size frameSize = new Size(width, height);
        mCamera.set(Highgui.CV_CAP_PROP_FRAME_WIDTH, frameSize.width);
        mCamera.set(Highgui.CV_CAP_PROP_FRAME_HEIGHT, frameSize.height);
    }

    return true;
}

private void releaseCamera() {
    synchronized (this) {
        if (mCamera != null) {
            mCamera.release();
        }
    }
}

private void disconnectCamera() {
    // 1. Stop thread which updating the frames
    // 2. Stop camera and release it
    try {
        mStopThread = true;
        mThread.join();
    } catch (InterruptedException e) {
        e.printStackTrace();
    } finally {
        mThread =  null;
        mStopThread = false;
    }
    releaseCamera();
}

private class CameraWorker implements Runnable {
    public void run() {
        do {
            if (!mCamera.grab()) {
                Log.e(TAG, "Camera frame grab failed");
                break;
            }
            Log.e(TAG, "Camera frame grabbed");
            // img processing
        } while (!mStopThread);
    }
}

@Override
public IBinder onBind(Intent intent) {
    return null; // Not used
}
}

我的日志：

11-29 12:28:24.370: D/OpenCVManager/Helper(5257): Init finished with status 0
11-29 12:28:24.370: D/OpenCVManager/Helper(5257): Unbind from service
11-29 12:28:24.380: D/OpenCVManager/Helper(5257): Calling using callback
11-29 12:28:24.380: I/(5257): OpenCV loaded successfully
11-29 12:28:24.380: D/OpenCV::camera(5257): CvCapture_Android::CvCapture_Android(0)
11-29 12:28:24.440: D/OpenCV_NativeCamera(5257): Connecting to CameraService v 3D
11-29 12:28:24.670: D/OpenCV_NativeCamera(5257): Instantiated new CameraHandler (0x75e4f29d, 0x71e178b8)
11-29 12:28:24.750: D/OpenCV_NativeCamera(5257): Starting preview
11-29 12:28:25.421: E/OpenCV_NativeCamera(5257): CameraHandler::doCall(void*, size_t): cameraCallback returns false (camera connection will be closed)
11-29 12:28:25.421: E/BufferQueue(5257): [unnamed-5257-0] dequeueBuffer: min undequeued buffer count (2) exceeded (dequeued=11 undequeudCount=0)
11-29 12:28:25.431: E/BufferQueue(5257): [unnamed-5257-0] dequeueBuffer: min undequeued buffer count (2) exceeded (dequeued=10 undequeudCount=1)
11-29 12:28:25.451: D/OpenCV_NativeCamera(5257): Preview started successfully
11-29 12:28:25.451: D/OpenCV_NativeCamera(5257): CameraHandler::setProperty(0, 640.000000)
11-29 12:28:25.451: D/OpenCV_NativeCamera(5257): CameraHandler::setProperty(1, 480.000000)
11-29 12:28:25.451: D/MyService(5257): initializeCamera successfully
11-29 12:28:25.451: D/MyService(5257): Camera successfully connected
11-29 12:28:25.451: I/Choreographer(5257): Skipped 86 frames!  The application may be doing too much work on its main thread.
11-29 12:28:25.471: A/libc(5257): @@@ ABORTING: LIBC: HEAP MEMORY CORRUPTION IN tmalloc_small
11-29 12:28:25.471: A/libc(5257): Fatal signal 11 (SIGSEGV) at 0xdeadbaad (code=1), thread 5257 ()

出了什么问题，我现在该怎么办？

【问题讨论】：

我总是得到错误日志：11-28 13:19:04.095: E/OpenCV::camera(2931): ||libnative_camera_r2.3.3.so，但它是有效的。忽略此条目
但之后：D/OpenCV_NativeCamera(2931): Connecting to CameraService v 3D，什么也没发生。该应用程序是 forzen。
这是本机示例。如何从相机中获取帧？
我已经更新了我的服务，但我仍然遇到问题。有人有想法吗？
您有下一个日志：@@@ ABORTING: LIBC: HEAP MEMORY CORRUPTION IN tmalloc_small。 Android 中的 Service 下一个工作：如果资源出现问题，Android 可以停止该服务

标签： java android opencv

【解决方案1】：

您可以使用原生变体(VideoCapture)。 CameraBridgeViewBase - 从 Android.Camera 扩展，也不能在后台工作。如果您没有找到示例，请在 OpenCv-2.4.2 Android 库中查看示例 FaceDetection

更新：

您可以使用 Inteface Runnable 从相机获取帧：

private VideoCapture        mCamera;

public void run() {
        Log.i(TAG, "Starting processing thread");

    while (true) {
        Bitmap bmp = null;

        synchronized (this) {
            if (mCamera == null)
                break;

            if (!mCamera.grab()) {
                Log.e(TAG, "mCamera.grab() failed");
                break;
            }

            bmp = processFrame(mCamera);

        }

}

【讨论】：