折腾：
【未解决】uiautomator2中如何获取到欢乐大作战游戏界面中的元素
期间，去试试OpenCV
去检测界面中的元素
比如 主线关卡 背包 英雄 任务 等等
opencv python
OpenCV本身是C++实现的
此处提供Python（的打包wrapper的）接口
还支持了Numpy，其提供了类似Matlab的语法
所有的OpenCV数组结构，都可以和Numpy的数组互相转换。
-》OpenCV中的数组支持Numpy的数组的所有操作。
而且还能用其他支持Numpy的库，比如SciPy，Matplotlib
所以OpenCV-Python很适合对于计算机视觉方面的问题的快速原型验证
用OpenCV-Python之前，最好对于Python，尤其是Numpy很熟悉，这样才能写出性能好的代码。
先去安装OpenVC
但是并没有找到如何在mac中安装
1 | pip install opencv-python |
那直接去
1 2 3 4 5 6 7 8 9 10 11 12 | ➜ autoTestAndroidGameHappyBigBattle pipenv install opencv-pythonCourtesy Notice: Pipenv found itself running within a virtual environment, so it will automatically use that environment, instead of creating its own for any project. You can set PIPENV_IGNORE_VIRTUALENVS=1 to force pipenv to ignore that environment and create its own instead. You can set PIPENV_VERBOSITY=-1 to suppress this warning.Installing opencv-python…Adding opencv-python to Pipfile's [packages]…Pipfile.lock (bfc05b) out of date, updating to (ae4f88)…Locking [dev-packages] dependencies…Locking [packages] dependencies…Updated Pipfile.lock (bfc05b)!Installing dependencies from Pipfile.lock (bfc05b)… |
Installation Succeeded 
▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉ 27/27 — 00:00:06看看依赖：
1 2 3 | ➜ autoTestAndroidGameHappyBigBattle pipenv graphopencv-python==4.1.2.30 - numpy [required: >=1.14.5, installed: 1.17.4] |
然后去导入代码试试
1 2 3 4 5 6 7 | ➜ autoTestAndroidGameHappyBigBattle pythonPython 3.7.3 (default, May 22 2019, 10:55:14) [Clang 10.0.1 (clang-1001.0.46.4)] on darwinType "help", "copyright", "credits" or "license" for more information.>>> import cv2>>> print(cv2.__version__)4.1.2 |
安装好了。
此处需要先去uiautomator2中截图
参考
1 | screen = self.d.screenshot(format="opencv") |
再去考虑如何从截图中识别想要识别的部分
1 2 | curScreen = d.screenshot(format="opencv")logging.info("curScreen=%s", curScreen) |
结果：
看起来是可以获取到了截屏图片
那接着去尝试用cv2打开看看截图图片
拷贝出：
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 | array([[[145, 111, 51], [144, 110, 50], [143, 109, 49], ..., [155, 118, 62], [154, 117, 61], [154, 117, 61]], [[144, 110, 50], [144, 110, 50], [143, 109, 49], ..., [155, 118, 62], [154, 117, 61], [154, 117, 61]], [[143, 109, 49], [143, 109, 49], [144, 110, 51], ..., [155, 118, 62], [154, 117, 61], [154, 117, 61]], ..., [[177, 119, 47], [178, 120, 48], [178, 120, 48], ..., [255, 255, 255], [255, 255, 255], [255, 255, 255]], [[176, 118, 46], [177, 119, 47], [177, 119, 47], ..., [255, 255, 255], [255, 255, 255], [255, 255, 255]], [[176, 118, 46], [177, 119, 47], [177, 119, 47], ..., [255, 255, 255], [255, 255, 255], [255, 255, 255]]], dtype=uint8) |