美文网首页
pyspider源码-schuduler.py之deque

pyspider源码-schuduler.py之deque

作者: comboo | 来源:发表于2017-04-05 11:04 被阅读62次

import itertools
import json
import logging
import os
import time
from collections import deque

from six import iteritems, itervalues
from six.moves import queue as Queue

from pyspider.libs import counter, utils
from pyspider.libs.base_handler import BaseHandler
from .task_queue import TaskQueue

from collections import deque

deque

Returns a new deque object initialized left-to-right (using append()
) with data from iterable. If iterable is not specified, the new deque is empty.
Deques are a generalization of stacks and queues (the name is pronounced “deck” and is short for “double-ended queue”). Deques support thread-safe, memory efficient appends and pops from either side of the deque with approximately the same O(1) performance in either direction.
Though list
objects support similar operations, they are optimized for fast fixed-length operations and incur O(n) memory movement costs for pop(0)
and insert(0,v)
operations which change both the size and position of the underlying data representation.

返回一个新的先进先出的列表对象 ,如果没有声明,这个列表是空的.

Deques是线程安全的.和list支持一样的操作.

from collections import deque 
for each in deque('asdfs'):
    print each

run

a
s
d
f
s
[Finished in 0.0s]

相关文章

  • pyspider源码-schuduler.py之deque

    import itertoolsimport jsonimport loggingimport osimport ...

  • pyspider源码-schuduler.py之itertool

    import itertoolsimport jsonimport loggingimport osimport ...

  • ArrayDeque

    ArrayDeque 原文见Java 容器源码分析之 Deque 与 ArrayDeque。 概述 ArrayDe...

  • STL容器(2)-deque类

    STL源码解析(2)-deque类 deque是类似于vector的动态数组,与之不同的是支持在头部的插入、删除操...

  • Java集合--Queue(Java中实现2)

    1.1 Deque源码(基于JDK1.7.0_45) 本票中,我们来看看Deque源码,在Queue基础上,又增...

  • pyspider源码分析

    pyspider代码结构 主要从以下几个模块看pyspider源码 libs里面的工具类。比如最常用的baseha...

  • Deque Java 源码

    Deque 双端队列(Double Ended Queue)允许两头都进、都出的队列。特性是 既可以添加到队首,也...

  • pyspider源码-scheduler

    思路 通过run发现,scheduler模块从队列拿到信息执行run_once这个方法。而run_once执行了下...

  • Java ArrayDeque

    以下内容转载至Java基础——Queue、Deque、ArrayDeque源码分析 Queue是什么 Queue是...

  • pyspider源码-run.py之xmlrpclib

    RPC的服务 RPC是指远程过程调用,也就是说两台服务器A,B,一个应用部署在A服务器上,想要调用B服务器上应用提...

网友评论

      本文标题:pyspider源码-schuduler.py之deque

      本文链接:https://www.haomeiwen.com/subject/koutattx.html