美文网首页安卓开发
AccessibilityService使用详解

AccessibilityService使用详解

作者: CarlosLynn | 来源:发表于2019-04-29 18:55 被阅读0次

前奏:

在你的手机更多设置或者高级设置中,我们会发现有个无障碍的功能,很多人不知道这个功能具体是干嘛的,其实这个功能是为了增强用户界面以帮助残障人士,或者可能暂时无法与设备充分交互的人们


image.png

它的具体实现是通过AccessibilityService服务运行在后台中,通过AccessibilityEvent接收指定事件的回调。
例如:焦点改变了,一个按钮被点击,等等。这样的服务可以选择请求活动窗口的内容的能力。简单的说AccessibilityService就是一个后台监控服务,当你监控的内容发生改变时,就会调用后台服务的回调方法

AccessibilityService使用

1.1创建服务类

编写自己的Service类,重写onServiceConnected()方法、onAccessibilityEvent()方法和onInterrupt()方法

/**
 * Created by zxn on 2019/4/29.
 */
public class PlugAccessibilityService extends AccessibilityService {

    /**
     * 当启动服务的时候就会被调用,系统成功绑定该服务时被触发,也就是当你在设置中开启相应的服务,
     * 系统成功的绑定了该服务时会触发,通常我们可以在这里做一些初始化操作
     */
    @Override
    protected void onServiceConnected() {
        super.onServiceConnected();
    }

    /**
     * 通过系统监听窗口变化的回调,sendAccessibiliyEvent()不断的发送AccessibilityEvent到此处
     *
     * @param event
     */
    @Override
    public void onAccessibilityEvent(AccessibilityEvent event) {
        int eventType = event.getEventType();
        //根据时间回调类型进行处理.
    }

    /**
     * 中断服务时的回调.
     */
    @Override
    public void onInterrupt() {

    }

    /**
     * 查找拥有特定焦点类型的控件
     *
     * @param focus
     * @return
     */
    @Override
    public AccessibilityNodeInfo findFocus(int focus) {
        return super.findFocus(focus);
    }

    /**
     * 如果配置能够获取窗口内容,则会返回当前活动窗口的根结点
     *
     * @return
     */
    @Override
    public AccessibilityNodeInfo getRootInActiveWindow() {
        return super.getRootInActiveWindow();
    }


    /**
     * 获取系统服务
     *
     * @param name
     * @return
     */
    @Override
    public Object getSystemService(String name) {
        return super.getSystemService(name);
    }

    /**
     * 如果允许服务监听按键操作,该方法是按键事件的回调,需要注意,这个过程发生了系统处理按键事件之前
     *
     * @param event
     * @return
     */
    @Override
    protected boolean onKeyEvent(KeyEvent event) {
        return super.onKeyEvent(event);
    }
}

1.1.1AccessibilityService中常用的方法的介绍

  • findFocus(int focus)
    查找拥有特定焦点类型的控件

  • getRootInActiveWindow()
    如果配置能够获取窗口内容,则会返回当前活动窗口的根结点

  • final void disableSelf()
    禁用当前服务,也就是在服务可以通过该方法停止运行

  • final AccessibilityServiceInfo getServiceInfo()
    获取当前服务的配置信息

  • onAccessibilityEvent(AccessibilityEvent event)
    有关AccessibilityEvent事件的回调函数,系统通过sendAccessibiliyEvent()不断的发送AccessibilityEvent到此处

  • performGlobalAction(int action)
    执行全局操作,比如返回,回到主页,打开最近等操作

  • setServiceInfo(AccessibilityServiceInfo info)
    设置当前服务的配置信息

  • getSystemService(String name)
    获取系统服务

  • onKeyEvent(KeyEvent event)
    如果允许服务监听按键操作,该方法是按键事件的回调,需要注意,这个过程发生了系统处理按键事件之前

  • onServiceConnected()
    系统成功绑定该服务时被触发,也就是当你在设置中开启相应的服务,系统成功的绑定了该服务时会触发,通常我们可以在这里做一些初始化操作

  • onInterrupt()
    服务中断时的回调

1.2 声明服务

在manifests中配置该服务信息

<service
    android:name=".PlugAccessibilityService"
    android:enabled="true"
    android:exported="true"
    android:label="@string/plug_name"
    android:permission="android.permission.BIND_ACCESSIBILITY_SERVICE">
    <intent-filter>
        <action android:name="android.intent.action.RESPOND_VIA_MESSAGE" />
    </intent-filter>
</service>

注意:任何一个信息配置错误,都会使该服务无反应

  • android:label:在无障碍列表中显示该服务的名字


    image.png
  • android:permission:需要指定BIND_ACCESSIBILITY_SERVICE权限,这是4.0以上的系统要求的
  • intent-filter:这个name是固定不变的

1.3 配置服务参数

配置服务参数是指:配置用来接受指定类型的事件,监听指定package,检索窗口内容,获取事件类型的时间等等。其配置服务参数有两种方法:

  • 方法一:安卓4.0之后可以通过meta-data标签指定xml文件进行配置

  • 方法二:通过代码动态配置参数

1.3.1 方法一

在原先的manifests中增加meta-data标签指定xml文件

<service
    android:name=".PlugAccessibilityService"
    android:enabled="true"
    android:exported="true"
    android:label="@string/plug_name"
    android:permission="android.permission.BIND_ACCESSIBILITY_SERVICE">
    <intent-filter>
        <action android:name="android.intent.action.RESPOND_VIA_MESSAGE" />
    </intent-filter>

    <meta-data
        android:name="android.accessibilityservice"
        android:resource="@xml/accessibility_service_config"
        />
</service>

接下来是accessibility_service_config文件的配置

<?xml version="1.0" encoding="utf-8"?>
<accessibility-service xmlns:android="http://schemas.android.com/apk/res/android"
    xmlns:android="http://schemas.android.com/apk/res/android"
    android:accessibilityEventTypes="typeAllMask"
    android:accessibilityFeedbackType="feedbackAllMask"
    android:accessibilityFlags="flagRequestFilterKeyEvents"
    android:canRequestFilterKeyEvents="true"
    android:canRetrieveWindowContent="true"
    android:notificationTimeout="100" />

下面是对xml参数的介绍
accessibilityEventTypes:表示该服务对界面中的哪些变化感兴趣,即哪些事件通知,比如窗口打开,滑动,焦点变化,长按等。具体的值可以在AccessibilityEvent类中查到,如typeAllMask表示接受所有的事件通知

accessibilityFeedbackType:表示反馈方式,比如是语音播放,还是震动

canRetrieveWindowContent:表示该服务能否访问活动窗口中的内容。也就是如果你希望在服务中获取窗体内容,则需要设置其值为true

description:对该无障碍功能的描述,具体体现在下图
notificationTimeout:接受事件的时间间隔,通常将其设置为100即可

packageNames:表示对该服务是用来监听哪个包的产生的事件

1.3.2 方法二

通过代码为我们的AccessibilityService配置AccessibilityServiceInfo信息

public void setAccessibilityServiceInfo() {
    String[] packageNames = {"com.tencent.mm"};
    AccessibilityServiceInfo accessibilityServiceInfo = new AccessibilityServiceInfo();
    //相应时间的类型,(长安,点击,滑动)
    accessibilityServiceInfo.eventTypes = AccessibilityEvent.TYPES_ALL_MASK;
    //反馈给用户的类型,这里是语音
    accessibilityServiceInfo.feedbackType = AccessibilityServiceInfo.FEEDBACK_SPOKEN;

    //过滤的包名
    accessibilityServiceInfo.packageNames = packageNames;
    setServiceInfo(accessibilityServiceInfo);
}

在这里涉及到了AccessibilityServiceInfo类,AccessibilityServiceInfo类被用于配置AccessibilityService信息,该类中包含了大量用于配置的常量字段及用来xml属性,常见的有:accessibilityEventTypes,canRequestFilterKeyEvents,packageNames等等

1.4 启动服务

这里我们需要在无障碍功能里面手动打开该项功能,否则无法继续进行,通过

下面代码可以打开系统的无障碍功能列表

Intent intent = new Intent(Settings.ACTION_ACCESSIBILITY_SETTINGS);
startActivity(intent);

1.5 处理事件信息

由于我们监听了事件的通知栏和界面等信息,当我们指定packageNames的通知栏或者界面发生变化时,会通过onAccessibilityEvent回调我们的事件,接着进行事件的处理

@Override
public void onAccessibilityEvent(AccessibilityEvent event) {
    int eventType = event.getEventType();
    //根据时间回调类型进行处理.
    switch (eventType) {
        //通知栏变化时
        case AccessibilityEvent.TYPE_NOTIFICATION_STATE_CHANGED:
            break;
        case AccessibilityEvent.TYPE_WINDOW_CONTENT_CHANGED:
            //当窗口状态发生改变时.
            break;
    }
}

当我们微信收到通知时,状态栏会有一条推送信息到达,这个时候就会被TYPE_NOTIFICATION_STATE_CHANGED监听,执行里面的内容,当我们切换微信界面时,或者使用微信时,这个时候就会被TYPE_WINDOW_STATE_CHANGED监听,执行里面的内容

AccessibilityEvent的方法

getEventType():事件类型

getSource():获取事件源对应的结点信息

getClassName():获取事件源对应类的类型,比如点击事件是有某个Button产生的,那么此时获取的就是Button的完整类名

getText():获取事件源的文本信息,比如事件是有TextView发出的,此时获取的就是TextView的text属性。如果该事件源是树结构,那么此时获取的是这个树上所有具有text属性的值的集合

isEnabled():事件源(对应的界面控件)是否处在可用状态

getItemCount():如果事件源是树结构,将返回该树根节点下子节点的数量

1.6 获取节点信息

AccessibilityNodeInfo nodeInfo = getRootInActiveWindow();

1.6.2 获取指定子节点(控件节点)

//通过文本找到对应节点集合.
AccessibilityNodeInfo nodeInfo = getRootInActiveWindow();

List<AccessibilityNodeInfo> textList = nodeInfo.findAccessibilityNodeInfosByText("");

//通过空间id找到对应的节点集合.
if (Build.VERSION.SDK_INT >= Build.VERSION_CODES.JELLY_BEAN_MR2) {
    List<AccessibilityNodeInfo> textIdList = nodeInfo.findAccessibilityNodeInfosByViewId("000");
}

1.7 模拟节点点击

当我们获取了节点信息之后,对控件节点进行模拟点击、长按等操作,AccessibilityNodeInfo类提供了performAction()方法让我们执行模拟操作,具体操作可看官方文档介绍,这里列举常用的操作

//模拟点击
nodeInfo.performAction(AccessibilityNodeInfo.ACTION_CLICK);
//模拟长安
nodeInfo.performAction(AccessibilityNodeInfo.ACTION_LONG_CLICK);
//模拟获取焦点
nodeInfo.performAction(AccessibilityNodeInfo.ACTION_FOCUS);
//模拟粘贴.
nodeInfo.performAction(AccessibilityNodeInfo.ACTION_PASTE);

监听控件插件实现

2.1 原理分析

2.2 注意事项

1,每个版本的按钮ID都是不一样的,在我们的程序中是需要去修改按钮ID,以达到版本的适配
2,在获取控件ID的时候,注意其布局是否可点击,否则获取不可点击的控件,会使程序无反应

2.3 获取控件ID

当我们手机接入USB线时,在Android Device Monitor中的选择设备并开启Dump View Hierarchy for UI Automator工具,通过它可以获取控件信息
monitor的安装目录.
C:\ZxnProgram\Android\Sdk\tools\monitor.bat

image.png

2.4 代码实现

科迈赢钱

包名:
com.pos.kmretailpos.mini
id:

com.pos.kmretailpos.mini:id/tv_waipay
com.pos.kmretailpos.mini:id/et_ys
科迈赢钱

包名:
com.pos.kmretailpos.mini
id:

com.pos.kmretailpos.mini:id/tv_waipay
com.pos.kmretailpos.mini:id/et_ys

AccessibilityEvent时间类型:

 /**
 * View被点击--->1
 * Represents the event of clicking on a {@link android.view.View} like
 * {@link android.widget.Button}, {@link android.widget.CompoundButton}, etc.
 */
public static final int TYPE_VIEW_CLICKED = 0x00000001;

/**
 * View被长按
 * Represents the event of long clicking on a {@link android.view.View} like
 * {@link android.widget.Button}, {@link android.widget.CompoundButton}, etc.
 */
public static final int TYPE_VIEW_LONG_CLICKED = 0x00000002;

/**
 * View被选中
 * Represents the event of selecting an item usually in the context of an
 * {@link android.widget.AdapterView}.
 */
public static final int TYPE_VIEW_SELECTED = 0x00000004;

/**
 * View获得焦点
 * Represents the event of setting input focus of a {@link android.view.View}.
 */
public static final int TYPE_VIEW_FOCUSED = 0x00000008;

/**
 * View文本变化
 * Represents the event of changing the text of an {@link android.widget.EditText}.
 */
public static final int TYPE_VIEW_TEXT_CHANGED = 0x00000010;

/**
 * 监听窗口状态变化,比如打开一个popupWindow,dialog,Activity切换等等.打开了一个PopupWindow,Menu或Dialog(--->32)
 * Represents the event of a change to a visually distinct section of the user interface.
 * These events should only be dispatched from {@link android.view.View}s that have
 * accessibility pane titles, and replaces {@link #TYPE_WINDOW_CONTENT_CHANGED} for those
 * sources. Details about the change are available from {@link #getContentChangeTypes()}.
 */
public static final int TYPE_WINDOW_STATE_CHANGED = 0x00000020;

/**
 * Notification通知变化
 * Represents the event showing a {@link android.app.Notification}.
 */
public static final int TYPE_NOTIFICATION_STATE_CHANGED = 0x00000040;

/**
 * 一个View进入悬停
 * Represents the event of a hover enter over a {@link android.view.View}.
 */
public static final int TYPE_VIEW_HOVER_ENTER = 0x00000080;

/**
 *  一个View退出悬停
 * Represents the event of a hover exit over a {@link android.view.View}.
 */
public static final int TYPE_VIEW_HOVER_EXIT = 0x00000100;

/**
 * 触摸浏览事件开始
 * Represents the event of starting a touch exploration gesture.
 */
public static final int TYPE_TOUCH_EXPLORATION_GESTURE_START = 0x00000200;

/**
 * 触摸浏览事件完成
 * Represents the event of ending a touch exploration gesture.
 */
public static final int TYPE_TOUCH_EXPLORATION_GESTURE_END = 0x00000400;

/**
 * 窗口的内容发生变化,或子树根布局发生变化(--->2048)
 * Represents the event of changing the content of a window and more
 * specifically the sub-tree rooted at the event's source.
 */
public static final int TYPE_WINDOW_CONTENT_CHANGED = 0x00000800;

/**
 *  View滚动
 * Represents the event of scrolling a view. This event type is generally not sent directly.
 * @see View#onScrollChanged(int, int, int, int)
 */
public static final int TYPE_VIEW_SCROLLED = 0x00001000;

/**
 *  Edittext文字选中发生改变事件
 * Represents the event of changing the selection in an {@link android.widget.EditText}.
 */
public static final int TYPE_VIEW_TEXT_SELECTION_CHANGED = 0x00002000;

/**
 * 应用产生一个通知事件
 * Represents the event of an application making an announcement.
 */
public static final int TYPE_ANNOUNCEMENT = 0x00004000;

/**
 * 获得无障碍焦点事件
 * Represents the event of gaining accessibility focus.
 */
public static final int TYPE_VIEW_ACCESSIBILITY_FOCUSED = 0x00008000;

/**
 * 无障碍焦点事件清除
 * Represents the event of clearing accessibility focus.
 */
public static final int TYPE_VIEW_ACCESSIBILITY_FOCUS_CLEARED = 0x00010000;

/**
 *  在给定的移动粒度下遍历视图文本的事件
 * Represents the event of traversing the text of a view at a given movement granularity.
 */
public static final int TYPE_VIEW_TEXT_TRAVERSED_AT_MOVEMENT_GRANULARITY = 0x00020000;

/**
 *  开始手势监测
 * Represents the event of beginning gesture detection.
 */
public static final int TYPE_GESTURE_DETECTION_START = 0x00040000;

/**
 * 结束手势监测
 * Represents the event of ending gesture detection.
 */
public static final int TYPE_GESTURE_DETECTION_END = 0x00080000;

/**
 *  触摸屏幕事件开始
 * Represents the event of the user starting to touch the screen.
 */
public static final int TYPE_TOUCH_INTERACTION_START = 0x00100000;

/**
 * 触摸屏幕事件结束
 * Represents the event of the user ending to touch the screen.
 */
public static final int TYPE_TOUCH_INTERACTION_END = 0x00200000;

/**
 * 屏幕上的窗口变化事件,需要API 21+
 * Represents the event change in the system windows shown on the screen. This event type should
 * only be dispatched by the system.
 */
public static final int TYPE_WINDOWS_CHANGED = 0x00400000;

/**
 * View中的上下文点击事件
 * Represents the event of a context click on a {@link android.view.View}.
 */
public static final int TYPE_VIEW_CONTEXT_CLICKED = 0x00800000;

/**
 * 辅助用户读取当前屏幕事件
 * Represents the event of the assistant currently reading the users screen context.
 */
public static final int TYPE_ASSIST_READING_CONTEXT = 0x01000000;

/**
 * Change type for {@link #TYPE_WINDOW_CONTENT_CHANGED} event:
 * The type of change is not defined.
 */
public static final int CONTENT_CHANGE_TYPE_UNDEFINED = 0x00000000;

/**
 * Change type for {@link #TYPE_WINDOW_CONTENT_CHANGED} event:
 * One or more content changes occurred in the the subtree rooted at the source node,
 * or the subtree's structure changed when a node was added or removed.
 */
public static final int CONTENT_CHANGE_TYPE_SUBTREE = 0x00000001;

/**
 * Change type for {@link #TYPE_WINDOW_CONTENT_CHANGED} event:
 * The node's text changed.
 */
public static final int CONTENT_CHANGE_TYPE_TEXT = 0x00000002;

/**
 * Change type for {@link #TYPE_WINDOW_CONTENT_CHANGED} event:
 * The node's content description changed.
 */
public static final int CONTENT_CHANGE_TYPE_CONTENT_DESCRIPTION = 0x00000004;

/**
 * Change type for {@link #TYPE_WINDOW_STATE_CHANGED} event:
 * The node's pane title changed.
 */
public static final int CONTENT_CHANGE_TYPE_PANE_TITLE = 0x00000008;

/**
 * Change type for {@link #TYPE_WINDOW_STATE_CHANGED} event:
 * The node has a pane title, and either just appeared or just was assigned a title when it
 * had none before.
 */
public static final int CONTENT_CHANGE_TYPE_PANE_APPEARED = 0x00000010;

/**
 *
 * Change type for {@link #TYPE_WINDOW_STATE_CHANGED} event:
 * Can mean one of two slightly different things. The primary meaning is that the node has
 * a pane title, and was removed from the node hierarchy. It will also be sent if the pane
 * title is set to {@code null} after it contained a title.
 * No source will be returned if the node is no longer on the screen. To make the change more
 * clear for the user, the first entry in {@link #getText()} will return the value that would
 * have been returned by {@code getSource().getPaneTitle()}.
 */
public static final int CONTENT_CHANGE_TYPE_PANE_DISAPPEARED = 0x00000020;

/**
 * 一个窗口被添加了
 * Change type for {@link #TYPE_WINDOWS_CHANGED} event:
 * The window was added.
 */
public static final int WINDOWS_CHANGE_ADDED = 0x00000001;

/**
 * 一个被窗口移除了.
 * Change type for {@link #TYPE_WINDOWS_CHANGED} event:
 * A window was removed.
 */
public static final int WINDOWS_CHANGE_REMOVED = 0x00000002;

/**
 * Change type for {@link #TYPE_WINDOWS_CHANGED} event:
 * The window's title changed.
 */
public static final int WINDOWS_CHANGE_TITLE = 0x00000004;

/**
 * Change type for {@link #TYPE_WINDOWS_CHANGED} event:
 * The window's bounds changed.
 */
public static final int WINDOWS_CHANGE_BOUNDS = 0x00000008;

/**
 * Change type for {@link #TYPE_WINDOWS_CHANGED} event:
 * The window's layer changed.
 */
public static final int WINDOWS_CHANGE_LAYER = 0x00000010;

/**
 * Change type for {@link #TYPE_WINDOWS_CHANGED} event:
 * The window's {@link AccessibilityWindowInfo#isActive()} changed.
 */
public static final int WINDOWS_CHANGE_ACTIVE = 0x00000020;

/**
 * Change type for {@link #TYPE_WINDOWS_CHANGED} event:
 * The window's {@link AccessibilityWindowInfo#isFocused()} changed.
 */
public static final int WINDOWS_CHANGE_FOCUSED = 0x00000040;

/**
 * Change type for {@link #TYPE_WINDOWS_CHANGED} event:
 * The window's {@link AccessibilityWindowInfo#isAccessibilityFocused()} changed.
 */
public static final int WINDOWS_CHANGE_ACCESSIBILITY_FOCUSED = 0x00000080;

/**
 * Change type for {@link #TYPE_WINDOWS_CHANGED} event:
 * The window's parent changed.
 */
public static final int WINDOWS_CHANGE_PARENT = 0x00000100;

/**
 * Change type for {@link #TYPE_WINDOWS_CHANGED} event:
 * The window's children changed.
 */
public static final int WINDOWS_CHANGE_CHILDREN = 0x00000200;

/**
 *
 * Change type for {@link #TYPE_WINDOWS_CHANGED} event:
 * The window either entered or exited picture-in-picture mode.
 */
public static final int WINDOWS_CHANGE_PIP = 0x00000400;

相关文章

网友评论

    本文标题:AccessibilityService使用详解

    本文链接:https://www.haomeiwen.com/subject/vxdunqtx.html