您可以找到很多关于 OCR 的论文和软件,因为它被广泛用于许多应用程序中。我想为您的问题提供一个非常简单的解决方案,使用 numpy 和 opencv 来完成这项工作。
我们会做什么:
- 导入 numpy 和 opencv
- 加载您提供的图片
- 把它们关起来
- Make 函数,将返回给定图像中的数字数组
- 比较图 1 和图 2 中的数字
- 制作我们的“数字银行”,以便我们了解数字 9 的样子
- 将我们在图 3 中找到的数字与我们的“数字银行”进行比较
代码:
import cv2
import numpy as np
treshold = 70
#Treshold every image, so "0" in image means no digit and "1" is digit
image1 = (cv2.imread("number_1.png",0) > treshold).astype(np.uint8)
image2 = (cv2.imread("number_2.png",0) > treshold).astype(np.uint8)
image3 = (cv2.imread("number_3.png",0) > treshold).astype(np.uint8)
image4 = (cv2.imread("number_4.png",0) > treshold).astype(np.uint8)
函数,将返回给定图像中的数字数组:
def get_images_of_digits(image):
components = cv2.connectedComponentsWithStats(image, 8, cv2.CV_16U) #Separate digits
#Get position of every components
#For details how this works take a look at
#https://stackoverflow.com/questions/35854197/how-to-use-opencvs-connected-components-with-stats-in-python
position_of_digits = components[2]
number_of_digits = len(position_of_digits) - 1 #number of digits found in image
digits = [] #Array with every digit in image
for i in range(number_of_digits):
w = position_of_digits[i+1,0] #Left corner of digit
h = position_of_digits[i+1,1] #Top corner of digit
digit = image[h:h+height_of_digit,w:w+width_of_digit] #Cut this digit out of image
#Count how many white pixels there are
px_count = np.count_nonzero(digit)
#Divide every pixel by square root of count of pixels in digit.
#Why? If we make convolution with the same digit it will give us sweet "1", which means these digits are identical
digit = digit / np.sqrt(px_count)
digits.append(digit)
return digits #Return all digits
获取数字
d_1 = get_images_of_digits(image1)[0] #Digit "9" from first image
d_2 = get_images_of_digits(image2)[0] #Digit "9" from second image
d_3 = get_images_of_digits(image4)[0] #Digit "6" from last image
print(cv2.filter2D(d_1,-1,d_2).max()) #Digit "9" on image 1 and 2 match perfectly (result of convolution is 1).
#Filter2D does convolution (correlation to be precise, but they are the same for our purpose)
将第一个图像的数字“9”和最后一个图像的数字“6”放入数字库。然后遍历我们在图 3 中找到的每个数字,并将其与我们的数字银行进行比较。如果分数低于 0.9,则不匹配。
bank_of_digits = {"9":d_1, "6":d_3}
for digit in get_images_of_digits(image3):
#print(digit)
best_restult = 0.9 #If score is above 0.9, we say it is match
#Maybe tweak this higher for separating chars "8" and "9" and "0"
matching_digit = "?" #Default char, when there is no match
for number in bank_of_digits:
score = cv2.filter2D(digit,-1,bank_of_digits[number]).max() #Returns 0-1 . 1 Means perfect match
print("Score for number " + number +" is: "+ str(np.round(score,2)) )
if score > best_restult: #If we find better match
best_restult = score #Set highest score yet
matching_digit = number #Set best match number
print("Best match: " + matching_digit)
最终结果将是“?”图 3 中的第一个数字,因为我们银行没有数字“1”,第二个结果将是“6”,得分为 0.97。
TLDR:我制作了从您的图像中分离数字并比较这些数字的算法。打印最佳匹配。