Received: from mail.netbsd.org (mail.netbsd.org [199.233.217.200]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.netbsd.org", Issuer "Postmaster NetBSD.org" (verified OK)) by mollari.NetBSD.org (Postfix) with ESMTPS id 309967A26C for ; Sat, 20 May 2017 06:25:38 +0000 (UTC) Received: by mail.netbsd.org (Postfix, from userid 605) id D1EE584D96; Sat, 20 May 2017 06:25:37 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by mail.netbsd.org (Postfix) with ESMTP id 5F8BE84CE3 for ; Sat, 20 May 2017 06:25:37 +0000 (UTC) X-Virus-Scanned: amavisd-new at netbsd.org Received: from mail.netbsd.org ([IPv6:::1]) by localhost (mail.netbsd.org [IPv6:::1]) (amavisd-new, port 10025) with ESMTP id e44cQlIJOhqL for ; Sat, 20 May 2017 06:25:36 +0000 (UTC) Received: from cvs.NetBSD.org (ivanova.netbsd.org [199.233.217.197]) by mail.netbsd.org (Postfix) with ESMTP id 95CE784C86 for ; Sat, 20 May 2017 06:25:36 +0000 (UTC) Received: by cvs.NetBSD.org (Postfix, from userid 500) id 8D2D6FBE4; Sat, 20 May 2017 06:25:36 +0000 (UTC) Content-Transfer-Encoding: 7bit Content-Type: multipart/mixed; boundary="_----------=_1495261536261990" MIME-Version: 1.0 Date: Sat, 20 May 2017 06:25:36 +0000 From: "Adam Ciarcinski" Subject: CVS commit: pkgsrc/www/py-scrapy To: pkgsrc-changes@NetBSD.org Reply-To: adam@netbsd.org X-Mailer: log_accum Message-Id: <20170520062536.8D2D6FBE4@cvs.NetBSD.org> Sender: pkgsrc-changes-owner@NetBSD.org List-Id: pkgsrc-changes.NetBSD.org Precedence: bulk List-Unsubscribe: This is a multi-part message in MIME format. --_----------=_1495261536261990 Content-Disposition: inline Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset="US-ASCII" Module Name: pkgsrc Committed By: adam Date: Sat May 20 06:25:36 UTC 2017 Modified Files: pkgsrc/www/py-scrapy: Makefile PLIST distinfo Added Files: pkgsrc/www/py-scrapy: ALTERNATIVES Log Message: Scrapy 1.4 does not bring that many breathtaking new features but quite a few handy improvements nonetheless. Scrapy now supports anonymous FTP sessions with customizable user and password via the new :setting:`FTP_USER` and :setting:`FTP_PASSWORD` settings. And if you're using Twisted version 17.1.0 or above, FTP is now available with Python 3. There's a new :meth:`response.follow ` method for creating requests; **it is now a recommended way to create Requests in Scrapy spiders**. This method makes it easier to write correct spiders; ``response.follow`` has several advantages over creating ``scrapy.Request`` objects directly: * it handles relative URLs; * it works properly with non-ascii URLs on non-UTF8 pages; * in addition to absolute and relative URLs it supports Selectors; for ```` elements it can also extract their href values. To generate a diff of this commit: cvs rdiff -u -r0 -r1.1 pkgsrc/www/py-scrapy/ALTERNATIVES cvs rdiff -u -r1.2 -r1.3 pkgsrc/www/py-scrapy/Makefile \ pkgsrc/www/py-scrapy/distinfo cvs rdiff -u -r1.1 -r1.2 pkgsrc/www/py-scrapy/PLIST Please note that diffs are not public domain; they are subject to the copyright notices on the relevant files. --_----------=_1495261536261990 Content-Disposition: inline Content-Length: 3735 Content-Transfer-Encoding: binary Content-Type: text/x-diff; charset=us-ascii Modified files: Index: pkgsrc/www/py-scrapy/Makefile diff -u pkgsrc/www/py-scrapy/Makefile:1.2 pkgsrc/www/py-scrapy/Makefile:1.3 --- pkgsrc/www/py-scrapy/Makefile:1.2 Sun Mar 19 22:59:10 2017 +++ pkgsrc/www/py-scrapy/Makefile Sat May 20 06:25:36 2017 @@ -1,6 +1,6 @@ -# $NetBSD: Makefile,v 1.2 2017/03/19 22:59:10 adam Exp $ +# $NetBSD: Makefile,v 1.3 2017/05/20 06:25:36 adam Exp $ -DISTNAME= Scrapy-1.3.3 +DISTNAME= Scrapy-1.4.0 PKGNAME= ${PYPKGPREFIX}-${DISTNAME:tl} CATEGORIES= www python MASTER_SITES= ${MASTER_SITE_PYPI:=S/Scrapy/} @@ -15,5 +15,9 @@ DEPENDS+= ${PYPKGPREFIX}-parsel>=1.1.0:. DEPENDS+= ${PYPKGPREFIX}-pydispatcher>=2.0.5:../../devel/py-pydispatcher DEPENDS+= ${PYPKGPREFIX}-twisted>=13.1.0:../../net/py-twisted +post-install: + ${MV} ${DESTDIR}${PREFIX}/bin/scrapy \ + ${DESTDIR}${PREFIX}/bin/scrapy${PYVERSSUFFIX} || ${TRUE} + .include "../../lang/python/egg.mk" .include "../../mk/bsd.pkg.mk" Index: pkgsrc/www/py-scrapy/distinfo diff -u pkgsrc/www/py-scrapy/distinfo:1.2 pkgsrc/www/py-scrapy/distinfo:1.3 --- pkgsrc/www/py-scrapy/distinfo:1.2 Sun Mar 19 22:59:11 2017 +++ pkgsrc/www/py-scrapy/distinfo Sat May 20 06:25:36 2017 @@ -1,6 +1,6 @@ -$NetBSD: distinfo,v 1.2 2017/03/19 22:59:11 adam Exp $ +$NetBSD: distinfo,v 1.3 2017/05/20 06:25:36 adam Exp $ -SHA1 (Scrapy-1.3.3.tar.gz) = 603b258932b868ad6315e374b7b3de8c45564264 -RMD160 (Scrapy-1.3.3.tar.gz) = a23e026285640af4cf1ec29590040a67ef57326d -SHA512 (Scrapy-1.3.3.tar.gz) = 795ac4a421be6e903e14cb9d9b242f4e6a130e3f51d43bf2a0904de0e4cadb4f54837badb63a65331ab67c4f8d6111f6fc85e6cb79acca5544db128b55ba3867 -Size (Scrapy-1.3.3.tar.gz) = 848990 bytes +SHA1 (Scrapy-1.4.0.tar.gz) = 24222debf2e6b9220a91a56c476c208ac5ecb8e5 +RMD160 (Scrapy-1.4.0.tar.gz) = ef20b9288851962fb552c1045e297c8917a74d17 +SHA512 (Scrapy-1.4.0.tar.gz) = eedcd7003c51f45a580f160b4e5f428c01713e4ecb5b64e35570bc750fc03bef7cc991e318ef4ff9c96e12a2d21cc32d0f07ce278486ea2e65f08e53c3e4a8f1 +Size (Scrapy-1.4.0.tar.gz) = 898159 bytes Index: pkgsrc/www/py-scrapy/PLIST diff -u pkgsrc/www/py-scrapy/PLIST:1.1 pkgsrc/www/py-scrapy/PLIST:1.2 --- pkgsrc/www/py-scrapy/PLIST:1.1 Mon Feb 13 21:25:33 2017 +++ pkgsrc/www/py-scrapy/PLIST Sat May 20 06:25:36 2017 @@ -1,5 +1,5 @@ -@comment $NetBSD: PLIST,v 1.1 2017/02/13 21:25:33 adam Exp $ -bin/scrapy +@comment $NetBSD: PLIST,v 1.2 2017/05/20 06:25:36 adam Exp $ +bin/scrapy${PYVERSSUFFIX} ${PYSITELIB}/${EGG_INFODIR}/PKG-INFO ${PYSITELIB}/${EGG_INFODIR}/SOURCES.txt ${PYSITELIB}/${EGG_INFODIR}/dependency_links.txt @@ -11,6 +11,9 @@ ${PYSITELIB}/scrapy/VERSION ${PYSITELIB}/scrapy/__init__.py ${PYSITELIB}/scrapy/__init__.pyc ${PYSITELIB}/scrapy/__init__.pyo +${PYSITELIB}/scrapy/__main__.py +${PYSITELIB}/scrapy/__main__.pyc +${PYSITELIB}/scrapy/__main__.pyo ${PYSITELIB}/scrapy/_monkeypatches.py ${PYSITELIB}/scrapy/_monkeypatches.pyc ${PYSITELIB}/scrapy/_monkeypatches.pyo @@ -254,6 +257,9 @@ ${PYSITELIB}/scrapy/core/downloader/cont ${PYSITELIB}/scrapy/core/downloader/handlers/__init__.py ${PYSITELIB}/scrapy/core/downloader/handlers/__init__.pyc ${PYSITELIB}/scrapy/core/downloader/handlers/__init__.pyo +${PYSITELIB}/scrapy/core/downloader/handlers/datauri.py +${PYSITELIB}/scrapy/core/downloader/handlers/datauri.pyc +${PYSITELIB}/scrapy/core/downloader/handlers/datauri.pyo ${PYSITELIB}/scrapy/core/downloader/handlers/file.py ${PYSITELIB}/scrapy/core/downloader/handlers/file.pyc ${PYSITELIB}/scrapy/core/downloader/handlers/file.pyo Added files: Index: pkgsrc/www/py-scrapy/ALTERNATIVES diff -u /dev/null pkgsrc/www/py-scrapy/ALTERNATIVES:1.1 --- /dev/null Sat May 20 06:25:36 2017 +++ pkgsrc/www/py-scrapy/ALTERNATIVES Sat May 20 06:25:36 2017 @@ -0,0 +1 @@ +bin/scrapy @PREFIX@/bin/scrapy@PYVERSSUFFIX@ --_----------=_1495261536261990--